-- Logs begin at Wed 2022-05-11 05:47:14 UTC, end at Wed 2022-05-11 07:00:33 UTC. -- May 11 06:30:00.961340 dv-cinder-804757-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 06:30:00.969985 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 06:30:00 2022] *** May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: nodename: dv-cinder-804757-27-iscsi May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: machine: x86_64 May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: clock source: unix May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: pcre jit disabled May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: detected number of CPU cores: 4 May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: current working directory: / May 11 06:30:00.972084 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: detected binary path: /usr/bin/uwsgi-core May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: your processes number limit is 47680 May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: your memory page size is 4096 bytes May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: detected max file descriptor number: 2048 May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: lock engine: pthread robust mutexes May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: thunder lock: enabled May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 06:30:00.972679 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 06:30:01.017097 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: Python main interpreter initialized at 0x555ff02a09c0 May 11 06:30:01.017097 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: python threads support enabled May 11 06:30:01.017097 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: your server socket listen backlog is limited to 100 connections May 11 06:30:01.017097 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: your mercy for graceful operations on workers is 90 seconds May 11 06:30:01.017541 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: mapped 403077 bytes (393 KB) for 2 cores May 11 06:30:01.017541 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: *** Operational MODE: preforking *** May 11 06:30:01.017780 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: *** uWSGI is running in multiple interpreter mode *** May 11 06:30:01.017780 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: spawned uWSGI master process (pid: 102946) May 11 06:30:01.017967 dv-cinder-804757-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 06:30:01.021729 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: spawned uWSGI worker 1 (pid: 102991, cores: 1) May 11 06:30:01.021729 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: spawned uWSGI worker 2 (pid: 102992, cores: 1) May 11 06:30:01.021729 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 06:30:02.211860 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 06:30:02.213025 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 06:30:02.940963 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:30:02.940963 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: from cryptography.utils import int_from_bytes May 11 06:30:02.941293 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:30:02.941293 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: from cryptography.utils import int_from_bytes May 11 06:30:02.952877 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:30:02.952877 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: from cryptography.utils import int_from_bytes May 11 06:30:02.953201 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:30:02.953201 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: from cryptography.utils import int_from_bytes May 11 06:30:05.511855 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:30:05.512471 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:30:05.512616 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:30:05.512977 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:30:05.513232 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:30:05.513618 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.513784 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:30:05.514135 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.514231 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:30:05.514320 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.514556 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:30:05.514651 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.514883 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.514983 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:30:05.515157 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:30:05.515249 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.515524 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.515617 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.515844 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.515936 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516169 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516260 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516432 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516583 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516750 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.516904 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517074 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-27-iscsi {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517191 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517390 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517485 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517697 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.517788 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518008 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518104 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518273 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518370 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518589 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518688 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.518919 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-27-iscsi {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.519077 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.519222 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.519358 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.519693 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.519823 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.520009 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.520273 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.520395 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.520609 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.520721 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521086 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521199 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521277 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521362 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521563 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521748 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.521855 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522060 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522156 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522366 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522459 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522677 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.522777 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523014 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523115 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523352 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523458 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-27-iscsi {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523664 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523763 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.523984 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524079 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524295 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524387 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524619 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524764 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.524930 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525056 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525323 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-27-iscsi {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525410 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525641 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525771 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.525976 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526091 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526395 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526589 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526724 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.526908 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527019 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527227 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527462 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527573 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527681 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527873 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.527967 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528177 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528271 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528483 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528576 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528797 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.528921 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529101 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529194 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529403 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529503 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529650 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529743 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.529953 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530039 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530270 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530364 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530587 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530673 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.530906 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531003 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531154 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531242 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531412 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531503 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531735 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.531828 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532050 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532138 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532357 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532446 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532660 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532756 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.532922 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533022 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533163 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533261 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533484 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533581 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533805 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.533892 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534114 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534200 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534415 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534544 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534717 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.534808 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535025 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535111 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535354 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535480 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535660 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535759 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.535964 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.536055 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.536789 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.536878 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537108 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537204 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537410 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537494 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537729 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.537825 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538039 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538125 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538341 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538438 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538655 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538746 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.538973 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539059 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539291 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539380 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539602 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539694 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539906 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.539999 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540221 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540320 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540540 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540636 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540842 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.540934 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541089 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541191 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541388 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541484 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541689 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.541782 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542001 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542103 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542303 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542396 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542607 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542698 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542871 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.542964 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543173 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543259 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543502 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543588 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543803 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.543895 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544104 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544189 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544407 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544499 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544713 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.544806 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545011 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545102 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545313 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545403 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545612 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545698 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545913 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.545999 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546215 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546299 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546521 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546608 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546822 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.546953 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547129 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547246 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547457 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547556 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547758 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.547845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548073 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548165 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548372 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548468 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548674 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548761 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.548978 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549074 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549281 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549424 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549586 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549685 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549901 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.549997 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550202 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550295 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550589 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550818 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.550911 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.551117 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.551203 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.551446 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.551534 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.551779 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.552462 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.552606 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.552705 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.552909 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.552997 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553210 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553312 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553512 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553597 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553813 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.553898 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554115 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554214 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554414 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554507 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554721 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.554814 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555018 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555119 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555357 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555461 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555663 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555755 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.555972 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556069 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556271 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556362 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556573 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556658 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556872 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.556962 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.557205 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.557338 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.557513 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.557599 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.557824 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.557911 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.558133 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.558228 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.558440 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.558537 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.558761 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:30:05.558849 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559078 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559177 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559413 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559517 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559728 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.559814 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560143 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560361 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560472 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560674 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560762 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.560986 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561302 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561397 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561617 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561703 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.561942 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562034 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562253 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562346 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562564 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562740 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562876 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.562963 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563183 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563335 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563524 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563610 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563848 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.563945 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564166 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564259 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564478 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564586 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564796 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.564890 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565203 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565428 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565519 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565745 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.565836 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566063 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566154 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566372 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566471 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566677 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566784 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.566987 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.567091 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.567327 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.567452 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.567937 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568047 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568246 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568332 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568564 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568650 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568874 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.568969 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569181 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569273 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569490 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569623 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569802 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.569904 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570111 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570205 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570436 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570520 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570747 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.570841 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571061 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571147 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571397 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571484 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571756 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.571849 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572023 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572118 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572331 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572417 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572640 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572738 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.572943 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573079 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573248 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573335 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573550 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573636 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573856 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.573942 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574158 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574253 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574469 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574561 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574778 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.574864 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575085 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575170 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575414 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575502 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575730 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.575830 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576037 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576135 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576348 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576436 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576657 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576743 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.576962 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577060 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577270 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577433 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577578 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577665 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577881 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.577980 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578193 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578284 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578499 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578594 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578803 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.578897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579115 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579201 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579452 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579539 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579758 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.579854 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580068 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580155 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580376 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580468 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580681 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580766 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.580986 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581070 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581293 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581378 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581596 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581682 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.581907 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582000 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582217 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582301 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582531 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582618 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.582932 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583185 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583304 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583536 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583625 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583850 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.583935 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584161 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584256 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584464 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584550 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584777 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.584864 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585088 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585188 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585376 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585469 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585676 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585762 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.585982 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586153 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586380 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586585 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586679 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586885 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.586980 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587187 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587323 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587514 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587665 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587825 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.587919 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588127 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588221 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588431 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588516 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588727 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.588814 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589029 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589115 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589335 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589419 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589654 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589777 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.589963 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590057 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590270 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590365 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590577 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590662 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590880 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.590965 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591203 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591320 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591539 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591624 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591846 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.591930 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592155 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592249 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592463 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592548 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592771 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.592863 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593088 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593182 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593395 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593481 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593706 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.593790 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594010 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594095 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594319 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594403 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594630 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594716 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.594947 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595033 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595246 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595363 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595589 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595681 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595900 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.595995 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596225 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596326 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596535 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596626 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596852 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.596937 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597157 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597240 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597469 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597600 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597777 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.597867 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.598083 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.598175 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.598391 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.598486 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599225 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599375 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599570 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599656 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599880 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.599983 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600189 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600286 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600493 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600578 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600800 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.600893 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601105 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601190 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601422 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601509 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601723 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.601818 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602033 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602118 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602340 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602423 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602664 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602757 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.602966 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603058 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603287 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603420 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603598 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603694 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603911 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.603995 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604219 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604306 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604533 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604620 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604835 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.604920 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605136 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605230 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605444 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605531 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605755 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.605842 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606062 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606154 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606372 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606456 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606673 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606757 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.606979 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607072 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607299 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607386 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607606 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607735 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.607907 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608009 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608215 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608308 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608518 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608602 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608825 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.608918 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609133 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609218 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609446 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609530 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609747 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.609833 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610048 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610134 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610366 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610451 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610672 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610760 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.610973 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611065 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611281 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611369 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611593 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611688 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.611909 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612001 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612224 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612310 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612525 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612613 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612828 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.612914 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613134 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613225 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613438 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613531 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613746 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.613830 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.614053 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.614147 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.614916 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615018 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615240 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615393 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615585 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615749 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615897 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.615983 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616215 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616302 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616522 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616614 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616831 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.616917 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617137 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617223 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617454 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617557 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617757 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.617841 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618065 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618156 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618368 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618461 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618668 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618761 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.618975 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619067 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619299 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619390 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619623 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619863 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.619949 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620285 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620503 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620589 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620816 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.620901 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.621131 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.621224 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.621443 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.621694 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.621789 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622027 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622121 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622344 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622430 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622662 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622760 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.622979 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623063 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623299 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623388 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623607 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623692 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623915 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.623999 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624218 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624305 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624520 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624616 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624820 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.624906 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625131 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625225 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625432 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625527 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625732 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.625818 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626032 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626126 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626331 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626417 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626635 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626720 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.626930 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627024 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627236 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627333 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627567 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627650 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627869 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.627973 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628177 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628264 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628475 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628559 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628777 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.628864 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629076 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629163 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629384 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629476 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629700 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.629786 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630032 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630116 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630341 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630427 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630646 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630733 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.630950 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631045 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631285 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631387 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631613 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631699 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.631920 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632006 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632224 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632319 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632525 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632611 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632834 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.632920 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633145 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633246 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633447 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633540 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633753 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.633837 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634059 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634157 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634360 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634453 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634664 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634755 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.634971 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635064 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635314 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635451 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635598 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635904 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.635990 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636209 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636295 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636511 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636606 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636810 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.636898 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637117 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637203 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637420 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637504 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637720 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.637807 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638024 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638108 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638322 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638416 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638622 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638706 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.638922 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639009 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639222 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639406 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639546 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639633 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639853 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.639948 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640153 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640246 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640451 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640536 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640761 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.640847 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641065 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641164 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641365 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641450 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641667 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641753 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.641970 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642057 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642271 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642355 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642568 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642651 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642874 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.642960 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643185 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643349 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643515 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643601 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643813 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.643907 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644115 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644201 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644413 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644500 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644714 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.644801 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645020 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645105 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645324 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645422 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645650 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645743 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.645949 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646034 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646248 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646342 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646550 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646643 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646850 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.646936 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647158 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647257 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647486 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647572 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647787 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.647873 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648087 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648180 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648386 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648490 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648686 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.648774 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649006 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649092 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649317 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649409 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649624 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649717 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.649929 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650016 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650233 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650326 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650544 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650630 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650850 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.650944 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651157 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651244 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651484 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651571 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651798 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.651885 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652105 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652191 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652426 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652510 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652727 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.652812 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653028 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653122 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653330 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653423 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653639 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653725 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.653946 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654032 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654258 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654351 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654564 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654658 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654869 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.654962 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655171 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655286 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655502 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655588 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655810 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.655895 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656117 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656223 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656423 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656518 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656727 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.656813 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657033 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657119 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657336 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657421 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657641 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657727 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.657947 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658033 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658250 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658495 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658590 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658669 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658846 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.658934 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659153 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659238 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659476 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659563 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659787 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.659881 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660092 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660191 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660395 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660531 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660703 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.660791 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.661002 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.661088 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.661825 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.661920 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662127 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662213 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662447 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662531 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662755 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.662855 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663068 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663162 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663404 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663505 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663720 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.663816 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664026 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664113 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664352 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664436 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664666 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664753 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.664976 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665070 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665345 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665432 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665660 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665753 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.665974 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666060 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666279 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666364 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666583 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666670 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666887 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.666986 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667195 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667324 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667544 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667633 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667848 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.667933 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668150 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668309 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668453 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668560 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668776 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.668880 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669078 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669174 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669398 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669491 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669700 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.669807 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670013 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670107 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670320 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670406 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670645 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670799 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.670951 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.671108 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.671288 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.671441 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.671742 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.671833 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672017 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672104 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672323 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672408 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672664 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672748 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.672974 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673061 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673369 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673605 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673711 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.673924 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674012 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674231 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674325 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674544 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674629 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674846 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.674939 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675155 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675242 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675499 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675587 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675812 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.675897 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676130 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676217 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676449 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676535 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676777 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.676902 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.677623 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.677711 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.677950 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678036 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678264 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678364 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678588 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678673 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678892 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.678999 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.679202 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.679445 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.679540 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.679628 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.679827 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680005 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680149 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680292 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680455 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680603 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680767 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.680912 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681075 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681227 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681383 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681536 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681688 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681846 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.681992 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682171 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682312 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682481 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682615 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682796 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.682933 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683244 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683446 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683585 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683757 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.683902 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684065 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684389 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684524 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684696 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.684832 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685021 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685139 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685336 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685442 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685658 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685752 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.685981 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686068 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686288 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686374 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686611 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686698 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.686923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687009 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687232 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687384 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687564 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687651 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687870 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.687957 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688211 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688306 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688518 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688604 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688829 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.688934 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689156 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689262 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689457 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689545 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689758 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.689846 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690066 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690160 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690367 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690454 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690669 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690757 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.690972 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691296 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691398 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691604 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691698 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.691906 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.692000 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.692207 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.692300 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.692551 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.692894 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693107 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693193 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693411 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693720 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.693813 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694022 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694108 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694322 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694407 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694623 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694715 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.694942 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695028 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695249 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695396 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695594 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695693 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695908 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.695995 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696217 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696315 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696526 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696621 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696829 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.696915 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697147 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697233 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697457 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697552 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697766 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.697851 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698077 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698163 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698389 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698483 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698701 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.698789 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699012 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699100 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699346 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699439 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699655 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699741 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.699969 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700057 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700279 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700368 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700591 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700684 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.700907 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701100 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701222 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701426 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701535 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701739 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.701833 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702052 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702149 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702363 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702450 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702675 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702762 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.702985 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.703257 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.703357 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.703613 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.703699 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.703916 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704015 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704225 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704312 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704536 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704621 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704853 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.704947 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705167 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705261 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705481 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705575 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705800 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.705923 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706109 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706216 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706416 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706502 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706725 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.706812 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.707074 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.707355 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.707459 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.707687 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.707776 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708027 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708115 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708341 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708428 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708654 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708783 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.708963 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709049 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709270 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709363 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709583 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709678 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709891 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.709977 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710199 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710294 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710506 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710595 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710818 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.710912 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711128 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711224 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711462 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711548 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711775 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.711872 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712091 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712186 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712403 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712497 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712712 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.712804 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713021 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713108 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713337 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713533 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713650 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713848 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.713973 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714178 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714305 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714498 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714627 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714819 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.714942 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.715138 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.715258 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.715477 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.715596 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.715799 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716104 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716190 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716404 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716489 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716712 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.716808 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717018 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717104 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717320 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717414 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717635 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717730 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.717942 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718030 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718242 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718328 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718556 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718649 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718860 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.718948 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.719169 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.719418 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.719519 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.719764 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.719852 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720083 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720176 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720400 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720498 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720707 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.720800 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721025 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721108 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721332 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721425 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721652 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721864 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.721960 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722212 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722298 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722532 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722626 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722841 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.722926 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.723143 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.723242 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.723473 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.723560 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.724295 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.724398 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.724607 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.724704 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.724912 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725006 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725222 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725311 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725532 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725627 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725842 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.725927 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726147 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726233 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726451 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726544 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726751 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.726837 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727059 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727147 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727386 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727493 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727691 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727778 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.727993 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728080 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728296 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728384 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728605 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728698 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.728907 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729042 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729210 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729297 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729509 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729594 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729813 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.729897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730110 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730197 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730417 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730511 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730718 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.730815 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731030 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731124 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731357 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731458 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731669 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731764 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.731974 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732061 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732374 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732584 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732683 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732893 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.732980 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733200 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733292 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733539 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733635 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733849 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.733942 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.734153 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.734366 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.734461 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.734697 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.734783 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735015 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735102 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735366 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735474 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735695 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735782 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.735996 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736081 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736296 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736391 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736599 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736850 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.736936 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737182 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737268 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737503 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737597 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737808 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.737893 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738115 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738281 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738422 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738508 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738733 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.738817 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.739036 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.739130 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.739415 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740044 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740230 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740324 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740538 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740632 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740846 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.740942 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741151 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741246 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741459 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741547 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741768 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.741868 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742080 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742174 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742390 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742484 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742698 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.742782 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743007 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743091 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743331 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743421 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743640 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743738 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.743947 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744048 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744263 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744349 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744576 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744661 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744891 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.744985 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745199 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745285 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745507 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745593 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745814 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.745913 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746123 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746217 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746433 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746519 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746744 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.746832 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747066 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747151 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747423 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747512 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747740 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.747827 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748046 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748132 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748366 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748461 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748675 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748762 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.748999 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749086 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749333 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749657 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749743 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.749975 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750069 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750278 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750376 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750580 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750669 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750881 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.750966 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751187 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751302 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751531 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751629 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751837 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.751932 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752138 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752234 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752440 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752527 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752746 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.752832 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753046 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753133 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753346 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753431 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753645 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753729 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.753945 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754033 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754248 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754334 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754549 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754635 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754848 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.754952 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755171 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755258 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755499 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755585 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755798 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.755885 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756099 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756184 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756399 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756492 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756696 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756782 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.756996 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757081 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757292 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757386 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757592 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757678 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757887 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.757972 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758186 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758284 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758492 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758604 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758806 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.758895 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759107 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759216 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759436 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759544 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759742 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.759832 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760048 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760149 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760350 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760446 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760666 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760751 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.760976 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761077 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761371 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761605 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761699 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761911 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.761998 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762220 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762308 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762525 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762622 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762829 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.762916 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763136 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763222 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763473 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763581 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763787 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.763874 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764105 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764190 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764409 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764503 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764717 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.764802 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765030 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765123 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765337 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765434 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765647 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765733 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.765953 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766038 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766276 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766363 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766582 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766674 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766889 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.766975 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767200 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767327 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767534 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767620 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767842 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.767927 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768153 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768241 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768463 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768555 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768783 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.768876 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769092 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769177 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769420 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769554 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769719 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.769849 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770028 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770114 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770345 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770431 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770687 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.770788 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771005 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771090 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771335 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771647 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771773 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.771951 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.772044 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.772192 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:30:05.772279 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.772615 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.772931 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.773273 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.773600 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.773916 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.774228 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.774536 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:30:05.774779 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:30:05.796069 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_db.sqlalchemy.engines [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:05.799393 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_db.sqlalchemy.engines [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:05.859632 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.context [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5f3ff89-f423-4501-b582-30555b4750ab(cell1) {{(pid=102992) load_cells /opt/stack/nova/nova/context.py:464}} May 11 06:30:05.862761 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.context [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5f3ff89-f423-4501-b582-30555b4750ab(cell1) {{(pid=102991) load_cells /opt/stack/nova/nova/context.py:464}} May 11 06:30:05.863955 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:30:05.866130 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:30:05.867231 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:30:05.867759 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_concurrency.lockutils [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:30:05.868882 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:30:05.869315 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_concurrency.lockutils [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:30:05.870110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_concurrency.lockutils [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:30:05.872109 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_concurrency.lockutils [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:30:05.882164 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_db.sqlalchemy.engines [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:05.882798 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_db.sqlalchemy.engines [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:05.886648 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_db.sqlalchemy.engines [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:05.889847 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_db.sqlalchemy.engines [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:06.039085 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_db.sqlalchemy.engines [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:06.048541 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG oslo_db.sqlalchemy.engines [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:30:06.377787 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: WARNING keystonemiddleware.auth_token [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:30:06.384675 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: WARNING keystonemiddleware.auth_token [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:30:06.385645 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: WARNING keystonemiddleware.auth_token [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:30:06.392039 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: WARNING keystonemiddleware.auth_token [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:30:06.729189 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: WARNING keystonemiddleware.auth_token [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:30:06.735341 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: WARNING keystonemiddleware.auth_token [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:30:06.739921 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: WARNING keystonemiddleware.auth_token [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:30:06.741972 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ff02a09c0 pid: 102992 (default app) May 11 06:30:06.744063 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:30:06.745223 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001751 May 11 06:30:06.745640 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed May 11 06:30:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:30:06.746023 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: WARNING keystonemiddleware.auth_token [None req-cf865cd6-3b9b-4529-a801-28c382eee3aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:30:06.752506 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ff02a09c0 pid: 102991 (default app) May 11 06:31:25.210792 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:25.212439 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 May 11 06:31:25.213109 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:25.641100 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-e569c8a1-c1e2-47ef-9db1-7a74cacf1599 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:25.670330 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-e569c8a1-c1e2-47ef-9db1-7a74cacf1599 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450426 May 11 06:31:25.671095 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed May 11 06:31:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:27.940207 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:27.941220 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-91c1a42e-9618-4789-addf-c18667caa2cf None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 11 06:31:27.942181 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:28.001157 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-07d85536-cb01-4a59-adf5-6ead51cb12bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:28.020085 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:31:28.020085 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: warnings.warn(msg) May 11 06:31:28.050712 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-07d85536-cb01-4a59-adf5-6ead51cb12bd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102470 May 11 06:31:28.052096 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:31:28.268264 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-3f9a0cd0-e002-47e4-a16c-c073fa7024e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:28.270766 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:31:28.270766 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:31:28.318137 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-3f9a0cd0-e002-47e4-a16c-c073fa7024e8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257958 May 11 06:31:28.327566 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed May 11 06:31:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:31:30.598775 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-07d85536-cb01-4a59-adf5-6ead51cb12bd admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:30.599829 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-07d85536-cb01-4a59-adf5-6ead51cb12bd admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 May 11 06:31:30.600250 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:30.714540 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-139a2d63-ca2b-45b6-a39d-370c60e94fc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:30.733063 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:31:30.733063 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:31:30.751289 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-139a2d63-ca2b-45b6-a39d-370c60e94fc0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145092 May 11 06:31:30.751843 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:30.763310 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-eaa07977-6e9d-4877-8acc-fd130bd14ceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:30.764788 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:31:30.764788 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: warnings.warn(msg) May 11 06:31:30.796724 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-eaa07977-6e9d-4877-8acc-fd130bd14ceb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037025 May 11 06:31:30.797304 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed May 11 06:31:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:33.073524 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-139a2d63-ca2b-45b6-a39d-370c60e94fc0 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:33.074778 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-139a2d63-ca2b-45b6-a39d-370c60e94fc0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 May 11 06:31:33.075544 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:33.134560 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-76b05a15-2921-4fd3-b8e4-3f428749d531 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "id": "d2"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:33.152984 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-76b05a15-2921-4fd3-b8e4-3f428749d531 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071226 May 11 06:31:33.153538 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:33.165252 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-cf96b58d-ccf9-416a-bf46-55794bb74d08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:33.190798 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-cf96b58d-ccf9-416a-bf46-55794bb74d08 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029128 May 11 06:31:33.192177 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed May 11 06:31:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:35.468479 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-76b05a15-2921-4fd3-b8e4-3f428749d531 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:35.469507 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-76b05a15-2921-4fd3-b8e4-3f428749d531 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 May 11 06:31:35.470005 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:35.531460 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-e547f4dd-61c3-4765-baa5-9ee1ac89146d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 10}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:35.552345 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-e547f4dd-61c3-4765-baa5-9ee1ac89146d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075766 May 11 06:31:35.552927 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:31:35.569193 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-a3287452-e992-47c0-8879-39eb83778684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:35.591876 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-a3287452-e992-47c0-8879-39eb83778684 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026610 May 11 06:31:35.592639 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed May 11 06:31:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:37.879836 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-e547f4dd-61c3-4765-baa5-9ee1ac89146d admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:37.880842 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-e547f4dd-61c3-4765-baa5-9ee1ac89146d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 May 11 06:31:37.881240 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:37.939342 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:37.959223 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072102 May 11 06:31:37.960135 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:31:37.972082 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-1de736d4-3bb4-4f30-a5aa-850cda7a6063 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:37.995095 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-1de736d4-3bb4-4f30-a5aa-850cda7a6063 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026945 May 11 06:31:37.996235 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed May 11 06:31:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:31:40.244285 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:40.245303 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 11 06:31:40.245714 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:40.310295 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-fa9e3eb3-243a-43b1-9ea6-5387b84bb4de admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:40.334605 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-fa9e3eb3-243a-43b1-9ea6-5387b84bb4de admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081866 May 11 06:31:40.335302 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed May 11 06:31:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:31:42.626819 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:42.627935 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-732752e6-da04-4502-a16e-b1aa1fbab33e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 11 06:31:42.628315 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:42.691182 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-978a4093-31c4-42bb-bacb-84dd49916992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:42.711242 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-978a4093-31c4-42bb-bacb-84dd49916992 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075693 May 11 06:31:42.711827 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:42.724251 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1e3ce60a-b970-4a1b-b97c-3e8ae01ee96e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:42.747240 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1e3ce60a-b970-4a1b-b97c-3e8ae01ee96e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027247 May 11 06:31:42.747843 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed May 11 06:31:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:31:45.082763 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-978a4093-31c4-42bb-bacb-84dd49916992 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:45.083803 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-978a4093-31c4-42bb-bacb-84dd49916992 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 11 06:31:45.084214 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:45.144235 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-0bded819-8661-4955-b049-4ad25d8e2230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:45.161494 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-0bded819-8661-4955-b049-4ad25d8e2230 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070242 May 11 06:31:45.162060 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:31:45.173638 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-d10e0652-9153-4689-b827-32341416d813 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:45.199193 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-d10e0652-9153-4689-b827-32341416d813 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029001 May 11 06:31:45.199959 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed May 11 06:31:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:47.460357 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-0bded819-8661-4955-b049-4ad25d8e2230 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:47.461361 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-0bded819-8661-4955-b049-4ad25d8e2230 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 11 06:31:47.461767 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:47.518647 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-dd6bc5a6-a2b7-491d-8b4b-31285ae4a1b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "id": "3", "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:47.538403 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-dd6bc5a6-a2b7-491d-8b4b-31285ae4a1b1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070981 May 11 06:31:47.539235 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:47.551539 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-d2b1cdf8-cba1-4809-a992-83491dbb1e18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:47.573584 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-d2b1cdf8-cba1-4809-a992-83491dbb1e18 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025861 May 11 06:31:47.574170 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed May 11 06:31:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:49.834282 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-dd6bc5a6-a2b7-491d-8b4b-31285ae4a1b1 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:49.835312 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-dd6bc5a6-a2b7-491d-8b4b-31285ae4a1b1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 11 06:31:49.835724 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:49.892320 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-13bc1ed3-8abe-4e97-918d-dc30b7fa47b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:49.909830 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-13bc1ed3-8abe-4e97-918d-dc30b7fa47b6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068540 May 11 06:31:49.911099 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:49.922828 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-14fde687-cbba-4ec6-87b1-cda16def1d2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:49.945910 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-14fde687-cbba-4ec6-87b1-cda16def1d2d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026738 May 11 06:31:49.946593 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed May 11 06:31:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:31:52.254853 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-13bc1ed3-8abe-4e97-918d-dc30b7fa47b6 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:31:52.257292 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-13bc1ed3-8abe-4e97-918d-dc30b7fa47b6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003438 May 11 06:31:52.257798 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:31:52.326519 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "disk": 160}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:52.345655 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080893 May 11 06:31:52.346465 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed May 11 06:31:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:31:52.359586 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-3b831587-14f1-4d47-8589-4bb37776484b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:31:52.383932 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-3b831587-14f1-4d47-8589-4bb37776484b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028113 May 11 06:31:52.384730 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed May 11 06:31:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:32:16.864099 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:16.865149 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 11 06:32:16.865553 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:16.920985 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-182c0c7a-6789-48be-8bda-aeac97fe049f admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:16.938488 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-182c0c7a-6789-48be-8bda-aeac97fe049f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066908 May 11 06:32:16.939011 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed May 11 06:32:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:32:17.936666 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:17.937676 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-106e381c-f089-4e03-9948-ec7c339aaf85 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 11 06:32:17.938100 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:18.141103 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-829c2f45-6765-477f-9b9b-fc0852cc8f43 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:18.147183 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.wsgi [None req-829c2f45-6765-477f-9b9b-fc0852cc8f43 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-829c2f45-6765-477f-9b9b-fc0852cc8f43 admin admin] Request method failure captured: May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept: application/json May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept-Encoding: gzip, deflate May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Connection: keep-alive May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Content-Length: 0 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Host: 10.222.0.64 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-Api-Version: compute 2.90 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-System-Scope: None May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: User-Agent: python-novaclient May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Auth-Token: gAAAAABie1hxd-EsjtpdSmQ8vfwBgo8Hs73tX7JJtdUyeSMmwp1kx0-aVTdlmZPyKUN8ygTJWC8RUuxObpLtmnEi7-1wUB8YEgUHwVkZBQQ7ih_4D6QdrH23GmbsDhxXjkrw9QCOnDj57CAXCSBOoPfxTraSNBfNft_9P7yfdNYT_HehLVewQCY May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Id: None May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Name: None May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Identity-Status: Confirmed May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Is-Admin-Project: True May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Id: default May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Name: Default May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Name: admin May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Role: admin,reader,member May 11 06:32:18.150448 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Roles: admin,reader,member May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant: admin May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Name: admin May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User: admin May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Id: default May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Name: Default May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Name: admin May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: method: > May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: exception: Flavor 42 could not be found. May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: action_args: {'id': '42'} May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:18.151845 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:18.152799 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:18.154198 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-829c2f45-6765-477f-9b9b-fc0852cc8f43 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:18.155544 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-829c2f45-6765-477f-9b9b-fc0852cc8f43 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074193 May 11 06:32:18.155544 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed May 11 06:32:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 06:32:18.162232 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-8010ad50-e35b-4b6e-ae61-fe47b53f28cd admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:18.183658 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-8010ad50-e35b-4b6e-ae61-fe47b53f28cd admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025674 May 11 06:32:18.184196 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:32:18.193510 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-244766f9-0097-48c8-b66f-e4a8dd47c775 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:18.215083 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-244766f9-0097-48c8-b66f-e4a8dd47c775 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025109 May 11 06:32:18.215639 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:32:18.225039 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-ca599bef-1de4-40b4-b7a4-59672ee6448a admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:18.230464 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.wsgi [None req-ca599bef-1de4-40b4-b7a4-59672ee6448a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-ca599bef-1de4-40b4-b7a4-59672ee6448a admin admin] Request method failure captured: May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept: application/json May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept-Encoding: gzip, deflate May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Connection: keep-alive May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Content-Length: 0 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Host: 10.222.0.64 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-Api-Version: compute 2.90 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-System-Scope: None May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: User-Agent: python-novaclient May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Auth-Token: gAAAAABie1hxd-EsjtpdSmQ8vfwBgo8Hs73tX7JJtdUyeSMmwp1kx0-aVTdlmZPyKUN8ygTJWC8RUuxObpLtmnEi7-1wUB8YEgUHwVkZBQQ7ih_4D6QdrH23GmbsDhxXjkrw9QCOnDj57CAXCSBOoPfxTraSNBfNft_9P7yfdNYT_HehLVewQCY May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Id: None May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Name: None May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Identity-Status: Confirmed May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Is-Admin-Project: True May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Id: default May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Name: Default May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Name: admin May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Role: admin,reader,member May 11 06:32:18.233686 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Roles: admin,reader,member May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant: admin May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Name: admin May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User: admin May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Id: default May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Name: Default May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Name: admin May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: method: > May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: exception: Flavor 42 could not be found. May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: action_args: {'id': '42'} May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:18.235204 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:18.239191 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:18.240504 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-ca599bef-1de4-40b4-b7a4-59672ee6448a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:18.241802 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-ca599bef-1de4-40b4-b7a4-59672ee6448a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014019 May 11 06:32:18.241802 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed May 11 06:32:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 11 06:32:19.112682 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-244766f9-0097-48c8-b66f-e4a8dd47c775 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:19.114337 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-244766f9-0097-48c8-b66f-e4a8dd47c775 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 May 11 06:32:19.114738 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:19.298762 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-0ff7b85b-15ea-4a9f-9d7f-9526c766a58a admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:19.305046 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.wsgi [None req-0ff7b85b-15ea-4a9f-9d7f-9526c766a58a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-0ff7b85b-15ea-4a9f-9d7f-9526c766a58a admin admin] Request method failure captured: May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept: application/json May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept-Encoding: gzip, deflate May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Connection: keep-alive May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Content-Length: 0 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Host: 10.222.0.64 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-Api-Version: compute 2.90 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-System-Scope: None May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: User-Agent: python-novaclient May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Auth-Token: gAAAAABie1hzaJTQOqHR9Sh5eETsTR19shWc3j0QBhQb_yUYFatwR6aMVrvM4Fymv_Nz3RDOiUU1LRYFqVSYlB6LVu-6y58-rtr7fR96CYEihS3ZzNb85pXzZIuAoSG-lxMy9WuwkrNhd37xZrlKoexxG1Ld1GTkJKrED7CGnAZA0x5Av3G0AMg May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Id: None May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Name: None May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Identity-Status: Confirmed May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Is-Admin-Project: True May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Id: default May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Name: Default May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Name: admin May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Role: admin,reader,member May 11 06:32:19.306529 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Roles: admin,reader,member May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant: admin May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Name: admin May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User: admin May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Id: default May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Name: Default May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Name: admin May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: method: > May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: exception: Flavor 84 could not be found. May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: action_args: {'id': '84'} May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:19.308051 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:19.308897 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:19.310058 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-0ff7b85b-15ea-4a9f-9d7f-9526c766a58a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:19.311337 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-0ff7b85b-15ea-4a9f-9d7f-9526c766a58a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060033 May 11 06:32:19.311337 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed May 11 06:32:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 06:32:19.317816 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-b3883267-2f49-414c-bb72-e9eb84b941bb admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:19.331726 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-b3883267-2f49-414c-bb72-e9eb84b941bb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017616 May 11 06:32:19.332269 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:32:19.341368 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-26f6c233-d780-4a11-b0b2-e777cbad31f8 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:19.355311 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-26f6c233-d780-4a11-b0b2-e777cbad31f8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017349 May 11 06:32:19.355860 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:32:19.365378 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-70c0f6f1-4f18-41c4-b9bd-8c73c9ea942e admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:19.370581 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.wsgi [None req-70c0f6f1-4f18-41c4-b9bd-8c73c9ea942e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-70c0f6f1-4f18-41c4-b9bd-8c73c9ea942e admin admin] Request method failure captured: May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept: application/json May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept-Encoding: gzip, deflate May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Connection: keep-alive May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Content-Length: 0 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Host: 10.222.0.64 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-Api-Version: compute 2.90 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-System-Scope: None May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: User-Agent: python-novaclient May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Auth-Token: gAAAAABie1hzaJTQOqHR9Sh5eETsTR19shWc3j0QBhQb_yUYFatwR6aMVrvM4Fymv_Nz3RDOiUU1LRYFqVSYlB6LVu-6y58-rtr7fR96CYEihS3ZzNb85pXzZIuAoSG-lxMy9WuwkrNhd37xZrlKoexxG1Ld1GTkJKrED7CGnAZA0x5Av3G0AMg May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Id: None May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Name: None May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Identity-Status: Confirmed May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Is-Admin-Project: True May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Id: default May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Name: Default May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Name: admin May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Role: admin,reader,member May 11 06:32:19.372110 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Roles: admin,reader,member May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant: admin May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Name: admin May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User: admin May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Id: default May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Name: Default May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Name: admin May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: method: > May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: exception: Flavor 84 could not be found. May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: action_args: {'id': '84'} May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:19.373684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:19.374701 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:19.376071 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-70c0f6f1-4f18-41c4-b9bd-8c73c9ea942e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:19.377283 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-70c0f6f1-4f18-41c4-b9bd-8c73c9ea942e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012255 May 11 06:32:19.377283 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed May 11 06:32:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 06:32:20.255705 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-26f6c233-d780-4a11-b0b2-e777cbad31f8 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:20.256708 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-26f6c233-d780-4a11-b0b2-e777cbad31f8 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 11 06:32:20.257107 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:20.453324 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-14837610-767d-424d-807f-58d84d31a83b admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:20.458915 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.wsgi [None req-14837610-767d-424d-807f-58d84d31a83b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-14837610-767d-424d-807f-58d84d31a83b admin admin] Request method failure captured: May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept: application/json May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Accept-Encoding: gzip, deflate May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Connection: keep-alive May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Content-Length: 0 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Host: 10.222.0.64 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-Api-Version: compute 2.90 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Openstack-System-Scope: None May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: User-Agent: python-novaclient May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Auth-Token: gAAAAABie1h0td7C95sSG_7X4HS1CzSesceTJaxYVDKTIQznYs7_HgyTlkHxHhfBDR1rjpoV5G9MCq6c7_ypLXqlE4YXNCXWs030hkfkXbCYDkCocgpE5hvdoiniK1g5Pibc7-DLLCDOfTLDar48A6V16wVlRzPdxi-iSH4nEvoSqq8vXeztbl4 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Id: None May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Domain-Name: None May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Identity-Status: Confirmed May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Is-Admin-Project: True May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Id: default May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Domain-Name: Default May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Project-Name: admin May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Role: admin,reader,member May 11 06:32:20.460425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Roles: admin,reader,member May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant: admin May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-Tenant-Name: admin May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User: admin May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Id: default May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Domain-Name: Default May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: X-User-Name: admin May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: method: > May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: exception: Flavor 451 could not be found. May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: action_args: {'id': '451'} May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:20.461923 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:20.462859 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: ERROR nova.api.openstack.wsgi May 11 06:32:20.464161 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-14837610-767d-424d-807f-58d84d31a83b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:20.465425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-14837610-767d-424d-807f-58d84d31a83b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060154 May 11 06:32:20.465425 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:32:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 06:32:20.471564 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-b6d4976c-c6b7-4379-914e-28cae5b43aa4 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:20.484808 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-b6d4976c-c6b7-4379-914e-28cae5b43aa4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016859 May 11 06:32:20.485326 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:32:20.494684 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:20.508507 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017165 May 11 06:32:20.509027 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed May 11 06:32:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:32:20.517779 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-da0181a9-fb4c-429a-9939-aa2496813010 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:20.522769 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.wsgi [None req-da0181a9-fb4c-429a-9939-aa2496813010 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-da0181a9-fb4c-429a-9939-aa2496813010 admin admin] Request method failure captured: May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept: application/json May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Accept-Encoding: gzip, deflate May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Connection: keep-alive May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Content-Length: 0 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Host: 10.222.0.64 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-Api-Version: compute 2.90 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Openstack-System-Scope: None May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: User-Agent: python-novaclient May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Auth-Token: gAAAAABie1h0td7C95sSG_7X4HS1CzSesceTJaxYVDKTIQznYs7_HgyTlkHxHhfBDR1rjpoV5G9MCq6c7_ypLXqlE4YXNCXWs030hkfkXbCYDkCocgpE5hvdoiniK1g5Pibc7-DLLCDOfTLDar48A6V16wVlRzPdxi-iSH4nEvoSqq8vXeztbl4 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Id: None May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Domain-Name: None May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Identity-Status: Confirmed May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Is-Admin-Project: True May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Openstack-Nova-Api-Version: 2.90 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Id: default May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Domain-Name: Default May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Project-Name: admin May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Role: admin,reader,member May 11 06:32:20.524283 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Roles: admin,reader,member May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cddb71d6492441b395049ab068255bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cddb71d6492441b395049ab068255bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cddb71d6492441b395049ab068255bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant: admin May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Id: cddb71d6492441b395049ab068255bc5 May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-Tenant-Name: admin May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User: admin May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Id: default May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Domain-Name: Default May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Id: 3d67c7af6def40d481bce9d42fed2d4f May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: X-User-Name: admin May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: method: > May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: exception: Flavor 451 could not be found. May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: action_args: {'id': '451'} May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:32:20.525736 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:20.526665 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: ERROR nova.api.openstack.wsgi May 11 06:32:20.527772 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-da0181a9-fb4c-429a-9939-aa2496813010 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:32:20.528760 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-da0181a9-fb4c-429a-9939-aa2496813010 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011264 May 11 06:32:20.528760 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:32:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 11 06:32:21.414944 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:21.416025 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 11 06:32:21.416421 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:21.606757 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-0bef90ba-37ab-4595-bc51-344e980d7473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:32:21.626310 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-0bef90ba-37ab-4595-bc51-344e980d7473 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072998 May 11 06:32:21.626871 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed May 11 06:32:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:32:22.539565 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:22.540567 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 11 06:32:22.540963 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:22.726994 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-da3a26c6-3bb8-47bd-b1c2-5bb1fefd70e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:32:22.743785 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-da3a26c6-3bb8-47bd-b1c2-5bb1fefd70e3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067140 May 11 06:32:22.744321 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed May 11 06:32:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:32:23.618716 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:23.619751 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 11 06:32:23.620165 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:23.805616 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-a395b390-e92d-4bcb-9c7b-1119a6c6f8f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:32:23.822608 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-a395b390-e92d-4bcb-9c7b-1119a6c6f8f0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066802 May 11 06:32:23.823141 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed May 11 06:32:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:32:24.705630 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:24.706626 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 11 06:32:24.707025 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:24.903415 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-a201e9bd-86ec-4121-a19a-65c845a506c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:32:24.920526 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-a201e9bd-86ec-4121-a19a-65c845a506c2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068179 May 11 06:32:24.921057 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed May 11 06:32:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:32:25.806831 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:25.807909 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 11 06:32:25.808304 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:32:25.993150 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-c67dd1ad-1e5a-4c23-881a-cde177c6fad5 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:32:26.012581 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-c67dd1ad-1e5a-4c23-881a-cde177c6fad5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069991 May 11 06:32:26.013114 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed May 11 06:32:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:33:27.613645 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.614594 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-2a5c1b01-3b02-4ff6-99d1-2ab869c1148c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 11 06:33:27.615006 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:33:27.671953 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-a1b0e730-01b5-46f6-af67-a98412e9b877 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.691838 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-a1b0e730-01b5-46f6-af67-a98412e9b877 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070933 May 11 06:33:27.692460 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:33:27.715352 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-d8d1fc23-1804-4a93-80d5-da9549acf70f admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.723980 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-d8d1fc23-1804-4a93-80d5-da9549acf70f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013169 May 11 06:33:27.724690 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:33:27.735924 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-17159d5c-b614-4a85-b97b-4627b427d1c9 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.743964 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-17159d5c-b614-4a85-b97b-4627b427d1c9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011656 May 11 06:33:27.744475 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:33:27.755951 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.763389 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011482 May 11 06:33:27.763907 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:33:27.774609 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-94cc6302-bab4-4446-aed7-33fa60e35bdb admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:33:27.781872 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-94cc6302-bab4-4446-aed7-33fa60e35bdb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010696 May 11 06:33:27.782381 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Wed May 11 06:33:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:36:49.111705 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:36:49.112727 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 11 06:36:49.113128 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:36:49.373687 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:36:49.375536 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:36:49.375536 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:36:49.376740 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:36:49.377183 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:36:49.378018 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:36:49.378449 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:36:49.411428 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-dd32729f-753f-4e46-9092-cb58cd192f67 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.147210 May 11 06:36:49.411995 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:36:49 2022] GET /compute/v2.1/os-services => generated 794 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:36:50.306959 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:36:50.308034 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 11 06:36:50.308434 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:36:50.498266 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:36:50.499986 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:36:50.499986 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:36:50.501164 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:36:50.501599 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:36:50.502380 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:36:50.502803 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:36:50.522038 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-d6cabaf6-b4d5-44db-9264-28a360aa60ba admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073738 May 11 06:36:50.522513 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:36:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:37:01.839770 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:01.840840 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 11 06:37:01.841248 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:37:02.042235 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:02.043687 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:37:02.043687 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:37:02.044917 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:02.045362 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:02.046163 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:02.046597 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:02.065248 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-a2be378c-de6d-4297-80f1-ddea01c4ec87 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078184 May 11 06:37:02.065832 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:37:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:37:02.968361 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:02.969367 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 11 06:37:02.969772 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:37:03.160486 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:03.161671 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:37:03.161671 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:37:03.162932 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:03.163402 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:03.164189 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:03.164604 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:03.185090 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-4f779067-566b-4ca8-95e9-ac971c087ef6 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077021 May 11 06:37:03.185639 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:37:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:37:14.497630 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:14.498637 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 11 06:37:14.499039 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 38/77] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:37:14.689097 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:14.690256 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:37:14.690256 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:37:14.691466 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:14.691899 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:14.692701 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:14.693122 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:14.716923 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-9702e831-93f5-42db-a801-7e4de25f8de6 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080473 May 11 06:37:14.717451 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 40/78] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:37:14 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:37:15.610849 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: DEBUG nova.api.openstack.wsgi [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] Calling method '>' {{(pid=102991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:15.611939 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: INFO nova.api.openstack.requestlog [None req-1b4971a5-8f37-402c-adce-87507f4cca61 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 11 06:37:15.612341 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: [pid: 102991|app: 0|req: 39/79] 10.222.0.64 () {56 vars in 1074 bytes} [Wed May 11 06:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:37:15.800415 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG nova.api.openstack.wsgi [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] Calling method '>' {{(pid=102992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:37:15.801579 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 06:37:15.801579 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: warnings.warn(msg) May 11 06:37:15.802745 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:15.803211 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:15.804021 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:37:15.804443 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: DEBUG oslo_concurrency.lockutils [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:37:15.825817 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: INFO nova.api.openstack.requestlog [None req-506b0c8c-4973-409a-a8e2-0eb3571a6115 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.075293 May 11 06:37:15.826351 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: [pid: 102992|app: 0|req: 41/80] 10.222.0.64 () {60 vars in 1193 bytes} [Wed May 11 06:37:15 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:38:14.340171 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: Wed May 11 06:38:14 2022 - graceful shutdown triggered... May 11 06:38:14.339968 dv-cinder-804757-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 06:38:14.341141 dv-cinder-804757-27-iscsi devstack@n-api.service[102991]: Gracefully killing worker 1 (pid: 102991)... May 11 06:38:14.342679 dv-cinder-804757-27-iscsi devstack@n-api.service[102992]: Gracefully killing worker 2 (pid: 102992)... May 11 06:38:15.340312 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: worker 1 buried after 1 seconds May 11 06:38:15.340312 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: worker 2 buried after 1 seconds May 11 06:38:15.340312 dv-cinder-804757-27-iscsi devstack@n-api.service[102946]: goodbye to uWSGI. May 11 06:38:15.342502 dv-cinder-804757-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 06:38:15.343059 dv-cinder-804757-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 06:38:15.345770 dv-cinder-804757-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 06:38:15.360075 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 06:38:15 2022] *** May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: nodename: dv-cinder-804757-27-iscsi May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: machine: x86_64 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: clock source: unix May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: pcre jit disabled May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: detected number of CPU cores: 4 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: current working directory: / May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: detected binary path: /usr/bin/uwsgi-core May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: your processes number limit is 47680 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: your memory page size is 4096 bytes May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: detected max file descriptor number: 2048 May 11 06:38:15.391497 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: lock engine: pthread robust mutexes May 11 06:38:15.392629 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: thunder lock: enabled May 11 06:38:15.392629 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 06:38:15.392629 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 06:38:15.436905 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: Python main interpreter initialized at 0x562b2a06e9c0 May 11 06:38:15.436905 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: python threads support enabled May 11 06:38:15.436905 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: your server socket listen backlog is limited to 100 connections May 11 06:38:15.436905 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: your mercy for graceful operations on workers is 90 seconds May 11 06:38:15.437244 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: mapped 403077 bytes (393 KB) for 2 cores May 11 06:38:15.437336 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: *** Operational MODE: preforking *** May 11 06:38:15.437594 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: *** uWSGI is running in multiple interpreter mode *** May 11 06:38:15.437594 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: spawned uWSGI master process (pid: 128908) May 11 06:38:15.437800 dv-cinder-804757-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 06:38:15.439448 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: spawned uWSGI worker 1 (pid: 128923, cores: 1) May 11 06:38:15.439448 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: spawned uWSGI worker 2 (pid: 128924, cores: 1) May 11 06:38:15.439448 dv-cinder-804757-27-iscsi devstack@n-api.service[128908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 06:38:16.659395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 06:38:16.664995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 06:38:17.463475 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:38:17.463475 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: from cryptography.utils import int_from_bytes May 11 06:38:17.463797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:38:17.463797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: from cryptography.utils import int_from_bytes May 11 06:38:17.476135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:38:17.476135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: from cryptography.utils import int_from_bytes May 11 06:38:17.476459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 06:38:17.476459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: from cryptography.utils import int_from_bytes May 11 06:38:19.942699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:38:19.943258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:38:19.943651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:38:19.943888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:38:19.944154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:38:19.944557 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.944893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.945222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.945555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.945897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.946218 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.946552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.946881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.947220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.947771 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.948099 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.948441 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-27-iscsi {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.948774 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.949091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.949413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.949742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.950058 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.950393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.950711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.951247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.952742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.952742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.952742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.952742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.953086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.953283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.953611 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.953944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.954264 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.954582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.954983 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-27-iscsi {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.955334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.955659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.955973 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.956400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.956715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.957028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.957357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.957688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.958008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.958353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.958675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.959002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.959357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.959674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.959989 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.960311 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.960650 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.960954 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.961268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.961530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.961846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.962180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.962513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.962845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.963104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.963384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.963713 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.964046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.964361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.964675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.964989 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.965306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.965622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.965936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.966254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.966568 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.966924 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.967248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.967599 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.967915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.968247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.968660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.968923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.969240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.969589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.969919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.970236 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.970564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.970892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.971212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.971554 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.971870 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.972199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.972531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.972847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.973107 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.973393 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 06:38:19.973915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.974090 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 06:38:19.974246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.974246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.974678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 06:38:19.974842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.975005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 06:38:19.975150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.975332 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 06:38:19.975496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.975658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.975810 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.975961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976283 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.976914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.977943 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.978094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.978252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.978830 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979170 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979332 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979511 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-27-iscsi {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.979808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.980892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.981057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.981232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.981522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.981784 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.981942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.982096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.982261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.982261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.983987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.984891 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985034 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.985963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-27-iscsi {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986717 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.986870 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987013 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987155 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.987993 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.988138 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.988288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.988433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.988872 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989279 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.989857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.990329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.990503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.990657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.990657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.990945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.991099 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.991250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.991449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.992482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.992645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.992808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.993462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.993632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.993803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.993956 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.994101 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.994254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.994407 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.994559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.994716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.994869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.995023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.995175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.995367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.995529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.995675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.995828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.995985 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.996140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.996291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.996444 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.996588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.996748 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.996899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.997051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.997203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.997347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.997508 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.997665 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.997810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.998002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.998967 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.999157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.999428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.999592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:19.999746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:19.999746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.000021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.000171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.000502 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.000684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.000839 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.000984 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.001136 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.001287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.001444 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.001597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.001840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.001999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.002144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.002314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.002547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.002706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.002861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.003006 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.003148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.003360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.003533 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.003685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.003830 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.003972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.004115 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.004257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.004413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.004557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.004718 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.004863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.005014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.005168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.005318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.005470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.005622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.005766 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.005910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.006062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.006214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.006358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.006508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.006663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.006814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.007036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.007185 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.007358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.007515 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.007658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.007800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.007956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.008108 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.008260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.008260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.008543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.008543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.009117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.009282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.009444 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.009687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.009838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.009997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.010141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.010291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.010460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.010785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.010931 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.011088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.011249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.011468 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.011629 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.011777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.012014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.012175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.012326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.012478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.012759 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.012906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.013054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.013209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.013360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.013527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.013693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.013846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.013990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.014141 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.014297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.014448 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.014604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.014757 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.014901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.015118 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.015286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.015462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.015615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.015773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.015918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.016060 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.016202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.016344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.016496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.016642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.016791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.016942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.017085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.017228 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.017390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.017541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.017693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.017844 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.017987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.018129 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.018286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.018453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.019478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.019649 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.019922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.020074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.020230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.020389 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.020534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.020875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.021037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.021193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.021345 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.021499 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.021662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.021662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.021939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.022184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.022346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.022491 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.022665 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.022887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.023048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.023202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.023371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.023516 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.023658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.023813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.023966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.024121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.024273 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.024416 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 06:38:20.024570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.024570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.024859 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025311 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025604 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.025900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026205 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.026954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.027906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028191 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028793 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.028945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.029089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.029266 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.029711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.029868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.030131 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.030293 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.030449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.030608 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.030783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.031090 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034325 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034485 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034787 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.034939 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035406 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.035901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.036989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037582 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.037894 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.038876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.039029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.039308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.039762 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.039917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040649 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.040947 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.041179 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.041438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.041607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.041755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.041901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042042 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042649 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.042946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.043097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.043248 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.043482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.043628 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.044011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.044178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.044326 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.044479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.044624 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.045278 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.045439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.045583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.045733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.045733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046664 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.046962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047750 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.047895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048495 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.048927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.049070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.049231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.049394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.049560 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.049990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.050144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.050318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.050559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.050725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.050871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.051014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.051184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.051464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.051726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.051905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052194 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.052946 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053551 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.053867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054177 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054491 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054649 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.054953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.055886 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.056927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057374 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.057987 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.058844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.059000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.059144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.059351 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.059514 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.059667 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.060107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.060259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.060403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.061275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.061447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.061677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062556 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.062846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.063922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.064974 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065285 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.065881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066311 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066758 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.066910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067445 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067758 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.067903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.068800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069759 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.069930 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.070349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.070496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.070648 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.070794 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.070945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.071101 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.071389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.071569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.071811 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.071970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.072265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.072667 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.072819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.072971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073122 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073576 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.073997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074170 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.074995 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075075 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075151 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075255 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075722 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075814 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.075942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076241 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.076981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077330 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077515 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077599 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.077970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078233 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078316 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078586 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078751 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.078930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079015 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079098 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079894 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.079993 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.080920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081817 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.081904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082007 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082101 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.082892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083359 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.083926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084735 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084735 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.084907 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.085928 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.086738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.087024 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.087126 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.087379 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.087654 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.087749 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088859 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.088953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.089260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.089448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.089578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.089896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.090057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.090217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.090589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.090696 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.090841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.091155 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.091257 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.091500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.091818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.091958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.092153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.092408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.092524 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.092788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.092992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.093095 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.093402 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.093624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.093718 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.094019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.094337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.094603 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.094848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.095080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.095180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.095442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.095731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.095826 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.096066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.096329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.096423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.096692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.096938 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.097038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.097325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.097535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.097629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.098050 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.098150 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.098373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.098656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.098750 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.099006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.099338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.099463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.099692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.099899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.100001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.100282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.100525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.100770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.100895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.101060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.101208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.101540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.101647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103396 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103677 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.103931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104724 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.104974 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.105614 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.105729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.105827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.105921 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106156 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106824 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.106917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.107145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.107990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.108110 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.108314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.108592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.108693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.108966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.109181 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.109283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.109619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.109806 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.110044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.110290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.110398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.110772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.110883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.111010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.111374 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.111540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.111694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112644 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.112955 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.113316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.113426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.113583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.113847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.113950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.114207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.114458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.114560 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.114821 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.115084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.115207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.115478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.115692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.115799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.116476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.116589 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.116689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.116775 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.116859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117427 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.117997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.118303 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.118493 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.118602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.118916 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.119078 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.119295 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.119610 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.119942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.120282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.120375 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.120621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.120913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.121029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.121272 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.121496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.121613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.121939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.122087 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.122268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.122598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.122714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.122933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.123810 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.123929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.124132 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.124412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.124508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.124746 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125263 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125363 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.125962 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.126575 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.126670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.126755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.126839 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.126931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.127209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.127391 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.127554 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.127871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.127968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.128276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.128587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.128733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.128876 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.129100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.129250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.129467 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.129629 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.129798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.130066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.130229 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.130455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.130606 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.130759 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131237 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.131976 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.132126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.132365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.132504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.132690 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.132988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.133142 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.133322 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.133461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.133642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.133993 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.134157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.134310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.134460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.134613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.134867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.135153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.135493 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.135638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.135791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.135944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.136155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.136306 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.136477 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.136712 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.136875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.137104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.137244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.137476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.137636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.137815 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.138251 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.138418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.138598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.138809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.138985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.139140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.139566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.139566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.139869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140024 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140473 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.140773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.141968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.142062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.142271 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.142513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.142622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.142900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.143000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.143219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.143464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.143577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.143908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144027 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.144961 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.145189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.145362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.145490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.145807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.145922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.146152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.146301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.146567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.146799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.147060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.147167 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.147490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.147590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.147993 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.148094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.148345 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.148492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.148710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.148926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.149040 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.149381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.149485 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.149713 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.149879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.150997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.151255 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.151496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.151722 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.151832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.152123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.152236 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.152450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.152659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.152764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.153078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.153188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.153405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.153579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.153743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.154020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.154941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.155053 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.155336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.155462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.155669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.155925 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156427 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.156996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.157299 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.157393 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.157616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.157821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.157923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.158245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.158369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.158565 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.158761 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.158864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.159183 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.159349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.159531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.159728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.159856 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.160169 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.160272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.160486 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.160672 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.160797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.161114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.161216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.161433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.161618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.161748 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162060 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162379 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.162996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.163098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.163330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.163534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.163637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.163952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.164051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.164263 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.164475 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.164583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.164940 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165047 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.165857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166410 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.166831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.167881 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.168113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.168206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.169868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.170569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.170660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.170748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.170833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.170917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.171988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.172103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.172342 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.172424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.172690 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.172780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173098 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.173995 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.174086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.174320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.174403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176343 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.176958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177041 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.177900 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.178832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.179053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.179146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.179411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.179738 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.180988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.181089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.181322 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.181424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.181636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.181729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.182905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.183009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.183244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.183395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.183693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.183786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.184999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185312 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.185979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.186962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.187056 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.187335 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.187446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.187678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.187782 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188650 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.188962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189698 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.189922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190236 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.190968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191519 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.191925 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192807 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.192915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193182 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193495 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.193815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194777 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.194964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195382 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195608 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.195922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196574 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.196916 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.197011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.197240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.197583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.197805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.197906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198537 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.198847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199493 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.199818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200134 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.200843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201001 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.201963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202056 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202311 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.202969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203108 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.203969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204289 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204722 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.204937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205255 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.205902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206218 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.206941 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207169 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207257 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207626 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207852 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.207943 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.208174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.208272 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.208510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.208748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.208845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209521 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.209836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210149 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.210805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211110 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211655 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:38:20.211757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.211995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.212352 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.212663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.212996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.213339 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.213663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.213989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.214377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.214697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.215062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.215410 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.215735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.216057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.216380 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.217227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.217549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.217866 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.218187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.218506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.218823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.219140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.219481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.219804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.220131 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.220471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.220799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.221121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.221441 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.221762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.222290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.222616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.222956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.223306 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.223644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.223969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.224294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.224627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.224943 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.225255 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.225578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.225893 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.226205 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.226531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.226848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.227159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.227545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.227865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.228405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.228762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.229086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.229420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.229753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.230077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.230550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.230719 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.231166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.231361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.231691 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.232009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.232348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.233234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.233555 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.233873 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.234188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.234511 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.234841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.235164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.235500 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.235821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.236131 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.236450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.236548 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.236763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.237074 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.237389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.237699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.238020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.238329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.238645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.238955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.239298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.239608 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.239922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.240290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.240623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.240938 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.241252 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.241577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.241897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.242227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.242546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.242867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.243224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.243571 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.244142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.244506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.244838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.245179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.245517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.245841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.246158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.246471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.246808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.247120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.247463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.247783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.248135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.248453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.248771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.249086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.249405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.249723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.250042 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.250358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.250675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.250998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.251372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.251700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.252026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.252347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.252670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.252988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.253305 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.253622 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.253936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.254258 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.254595 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.254914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.255226 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.255686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.256028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.256352 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.256679 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.256985 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.257312 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.257640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.257957 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.258283 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.258600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.258934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.259297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.259636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.259968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.260281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.260593 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.260904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.261220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.261679 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.261895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.262167 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.262461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.262773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.263084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.263426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.263764 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.264073 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.264388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.264695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.265003 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.265312 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.265626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.265936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.266244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.266556 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.266863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.267170 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.267499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.267810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.268117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.268456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.268792 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.269111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.269439 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.269757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.270084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.270402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.270730 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.271129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.271402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.271770 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.272112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.272431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.272749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.273064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.273382 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.273697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.274011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.274344 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.274674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.274988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.275339 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.275672 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.275998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.276320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.276640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.276974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.277294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.277611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.277929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.278249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.278564 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.278886 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.279754 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.280091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.280424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.280757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.281089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.281444 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.281765 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.282118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.282446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.282767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.283086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.283421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 06:38:20.283673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 06:38:20.305435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.context [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5f3ff89-f423-4501-b582-30555b4750ab(cell1) {{(pid=128923) load_cells /opt/stack/nova/nova/context.py:464}} May 11 06:38:20.310896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:38:20.312567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:38:20.313423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:38:20.314937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.315454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:38:20.327216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.329435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.379930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.context [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5f3ff89-f423-4501-b582-30555b4750ab(cell1) {{(pid=128924) load_cells /opt/stack/nova/nova/context.py:464}} May 11 06:38:20.384358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:38:20.385950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:38:20.386756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:38:20.388764 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:38:20.400284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.401966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.489472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_db.sqlalchemy.engines [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.569404 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 06:38:20.811310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: WARNING keystonemiddleware.auth_token [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:38:20.818841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: WARNING keystonemiddleware.auth_token [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:38:20.894663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:38:20.902699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:38:21.164699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: WARNING keystonemiddleware.auth_token [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:38:21.171863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: WARNING keystonemiddleware.auth_token [None req-e1ece740-54d0-4c9c-993a-761541f60f9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:38:21.176811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b2a06e9c0 pid: 128923 (default app) May 11 06:38:21.255905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 06:38:21.262161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-4ef56a3a-91b3-4dc5-ba13-a45d91d1d3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 06:38:21.268446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b2a06e9c0 pid: 128924 (default app) May 11 06:39:04.095495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b5ae08b0-6b0a-428d-b37a-164dad1c6b1d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Action: 'create', calling method: .version_select at 0x7fc5cac2d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-433228118"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:07.048227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1424035059", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "networks": [{"uuid": "60e72d39-a433-48d0-992d-627ab991ee5c"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:07.149998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b5ae08b0-6b0a-428d-b37a-164dad1c6b1d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.352343 May 11 06:39:07.151245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1154 bytes} [Wed May 11 06:39:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4355 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 06:39:07.166348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1268dbc6-acac-4bf2-9c46-3850c97213a2 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa86280>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:07.415984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1268dbc6-acac-4bf2-9c46-3850c97213a2 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 200 len: 345 microversion: 2.1 time: 0.256424 May 11 06:39:07.416822 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:07 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:07.428253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5e8fd484-cd84-44fb-9238-97ab446217df tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Action: 'create', calling method: .version_select at 0x7fc5caa863a0>, body: {"snapshot": {"volume_id": "1a38f108-2276-43c3-8364-4f0515be61d0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-764644744"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:07.587143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] validate_networks() for [('60e72d39-a433-48d0-992d-627ab991ee5c', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:39:07.759903 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5e8fd484-cd84-44fb-9238-97ab446217df tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.335566 May 11 06:39:07.760986 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 3/3] 10.222.0.64 () {60 vars in 1161 bytes} [Wed May 11 06:39:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:07.775685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f9f566e2-da5d-4ed5-9f88-dce2192fecfe tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa86ee0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:07.866731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f9f566e2-da5d-4ed5-9f88-dce2192fecfe tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 286 microversion: 2.1 time: 0.099268 May 11 06:39:07.873961 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:07 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:07.879847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c64488fe-41e3-4e86-a494-288c00bf3cec tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa825e0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:08.028963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c64488fe-41e3-4e86-a494-288c00bf3cec tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.153378 May 11 06:39:08.031533 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1139 bytes} [Wed May 11 06:39:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:08.056305 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1aeed8bc-7e3a-4acc-aa59-596b20975ace tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa86dc0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:08.219325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1aeed8bc-7e3a-4acc-aa59-596b20975ace tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 286 microversion: 2.1 time: 0.172937 May 11 06:39:08.221053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:08 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:09.253915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6f654385-11d5-4c5b-9478-1fd84cf8cf79 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa86790>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:09.308539 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6f654385-11d5-4c5b-9478-1fd84cf8cf79 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 286 microversion: 2.1 time: 0.067856 May 11 06:39:09.310353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 7/7] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:09 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:09.682117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:39:09.683731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:39:09.684457 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:39:09.685190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:39:09.688414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:39:09.717372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:09.717986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:09.718827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:09.719260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:09.779983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Getting quotas for project 08265213a8e840179ab9d62cf0bc86ab. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:09.795187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Getting quotas for user da53e103c1e74a9b8907a7076b234171 and project 08265213a8e840179ab9d62cf0bc86ab. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:09.818567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:39:09.825451 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:39:09.993839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-078e64bb-a658-4c2d-9324-000d9edba559 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.506169 May 11 06:39:09.995149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 1/8] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:39:10.005017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-630ec14b-f92e-41a6-8d37-5edb686ed336 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:10.005978 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-630ec14b-f92e-41a6-8d37-5edb686ed336 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:10.322856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a424e804-d617-468f-81dc-f9bdc0724501 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa33280>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:10.452392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a424e804-d617-468f-81dc-f9bdc0724501 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 286 microversion: 2.1 time: 0.134537 May 11 06:39:10.456406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 2/9] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:10 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:11.180474 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-630ec14b-f92e-41a6-8d37-5edb686ed336 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:11.217784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-630ec14b-f92e-41a6-8d37-5edb686ed336 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1215 microversion: 2.1 time: 1.216357 May 11 06:39:11.223665 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 8/10] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:10 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1215 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:11.484718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e272dfd7-8dfc-4c9e-a126-be2d70b527f5 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c9995c10>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:11.625399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e272dfd7-8dfc-4c9e-a126-be2d70b527f5 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 287 microversion: 2.1 time: 0.163779 May 11 06:39:11.627364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 3/11] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:11 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:11.640988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-33cf5051-a05c-4804-b0b9-368874c8c3d3 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa4d0d0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:11.945844 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-33cf5051-a05c-4804-b0b9-368874c8c3d3 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 202 len: 0 microversion: 2.1 time: 0.310930 May 11 06:39:11.947169 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 9/12] 10.222.0.64 () {58 vars in 1253 bytes} [Wed May 11 06:39:11 2022] DELETE /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:39:11.962684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c395ad3d-858e-46d1-ac53-556d65b1e7e6 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c999b310>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:12.083081 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c395ad3d-858e-46d1-ac53-556d65b1e7e6 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 200 len: 286 microversion: 2.1 time: 0.129372 May 11 06:39:12.083688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 4/13] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:11 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:12.238196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e6edc856-dc4f-4066-b75c-1cdc22d8675b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:12.238825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e6edc856-dc4f-4066-b75c-1cdc22d8675b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:12.397838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e6edc856-dc4f-4066-b75c-1cdc22d8675b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:12.406313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e6edc856-dc4f-4066-b75c-1cdc22d8675b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1215 microversion: 2.1 time: 0.172411 May 11 06:39:12.411291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 10/14] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:12 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:13.094756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-05445a35-5d7a-402c-837b-dd70d3f3b514 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c9995dc0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:13.374684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-05445a35-5d7a-402c-837b-dd70d3f3b514 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] HTTP exception thrown: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-05445a35-5d7a-402c-837b-dd70d3f3b514 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Request method failure captured: May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e HTTP/1.1 May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oGuJTQ6f-IDwTayqsmyEuiYZCyCBghj4J4gRidpvDCVd0Eg3Sj9ajI5qX6D-1qiP3ad5LMk2NiajKCg1Y2vUCT157yb_wSUVBAooPjR8rGomc11eGRNqsOysOpFJR73EiOfIfV5xEZYROH9vNQ5vSEA-GHlj46_BuLvi1doHfnuWs May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:13.378951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 2b2af35e12fc477387b443dd768274f4 May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'bd524caf-6666-4ce9-9852-66d362170e8e'} May 11 06:39:13.380467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. (HTTP 404) (Request-ID: req-f429acde-1b5c-4ca9-9477-8d2f9eae10d1) May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.381421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:13.382616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 06:39:13.384093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-05445a35-5d7a-402c-837b-dd70d3f3b514 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Returning 404 to user: Snapshot bd524caf-6666-4ce9-9852-66d362170e8e could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:13.385433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-05445a35-5d7a-402c-837b-dd70d3f3b514 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e" status: 404 len: 111 microversion: 2.1 time: 0.290366 May 11 06:39:13.386341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 5/15] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:39:13 2022] GET /compute/v2.1/os-snapshots/bd524caf-6666-4ce9-9852-66d362170e8e => generated 111 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:13.392186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-623eb688-6c6e-4a54-88be-ff3fdebff27e tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa82550>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:13.428665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:13.429554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:13.516165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:13.518186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:13.521400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:13.524478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:13.574000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-623eb688-6c6e-4a54-88be-ff3fdebff27e tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 202 len: 0 microversion: 2.1 time: 0.187990 May 11 06:39:13.576094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 11/16] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:39:13 2022] DELETE /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:39:13.584507 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5e53328b-845d-4dea-a320-034e30448492 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa5eaf0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:13.669865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5e53328b-845d-4dea-a320-034e30448492 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 200 len: 344 microversion: 2.1 time: 0.089483 May 11 06:39:13.671217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 12/17] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:13 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:13.976767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:14.008568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3c2dd907-2001-4abb-9b8e-c4ef838252b1 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1267 microversion: 2.1 time: 0.584022 May 11 06:39:14.009807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 6/18] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:13 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1267 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:14.682246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c8f490b8-d202-423a-aa12-fd933ffa35fc tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5caa5edc0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:14.806767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c8f490b8-d202-423a-aa12-fd933ffa35fc tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 200 len: 344 microversion: 2.1 time: 0.128613 May 11 06:39:14.814356 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 13/19] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:14 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:15.025388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:15.028648 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:15.062434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:15.069887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:15.070844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:15.073426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:15.640859 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:15.675960 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4f7078dd-cc1d-479f-a7a2-3c9783ac3de3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1267 microversion: 2.1 time: 0.647724 May 11 06:39:15.679667 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 7/20] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:15 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1267 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:15.818682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a364b1ea-3084-40a6-848b-e71c02723983 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c9848550>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:15.942152 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a364b1ea-3084-40a6-848b-e71c02723983 tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 200 len: 344 microversion: 2.1 time: 0.127200 May 11 06:39:15.943070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 8/21] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:15 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:15.990453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-48afaf28-51ec-4804-a773-67c437655f1f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: .version_select at 0x7fc5caa82430>, body: {"keypair": {"name": "tempest-keypair-651770994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvVCrpBNqtCIYBxIW3FezFcRdZox+XSmhHwEPEwq2tZUdXqwuYy5Typ2mQmv+L7x1QLiAl+N6RIs+qgJgIFNX/VVQs70sPs5Rgrx0fA4VrzFEk78A2BZhSlcdCwAy/aIg=="}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:16.136452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-48afaf28-51ec-4804-a773-67c437655f1f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:16.180569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-48afaf28-51ec-4804-a773-67c437655f1f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:16.289283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-48afaf28-51ec-4804-a773-67c437655f1f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.551974 May 11 06:39:16.290836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 14/22] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:39:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:16.693298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:16.694119 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:16.714561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:16.715017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:16.715868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:16.716314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:16.928605 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-56e0a498-efd1-4b0d-98b7-05168dde1a2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: .version_select at 0x7fc5c9848dc0>, body: {"keypair": {"name": "tempest-keypair-1330297397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCzi+TDQ7houPYVCHdh76/H3f/i4sfrlS10nCwv+EyqonnyKnebkJzCTFTaHgH2mPuJskstiBVCTAFO/L7F9RJqFPSon8+EhiUxgmF1Z5/yClqrfr0jfg0Gf8aU+HnfMQ=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:16.977237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-56e0a498-efd1-4b0d-98b7-05168dde1a2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for project ea42234bb6844ce88afe0725d859863e. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:17.017352 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-56e0a498-efd1-4b0d-98b7-05168dde1a2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for user 1f2d12e60ae147198c3940c510616285 and project ea42234bb6844ce88afe0725d859863e. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:17.113282 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-56e0a498-efd1-4b0d-98b7-05168dde1a2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.623942 May 11 06:39:17.115874 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 9/23] 10.222.0.64 () {62 vars in 1199 bytes} [Wed May 11 06:39:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 06:39:17.133475 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08a4ab4a-0bb4-48e0-a9d4-81ddddac370d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c98483a0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:17.202590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-08a4ab4a-0bb4-48e0-a9d4-81ddddac370d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] HTTP exception thrown: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08a4ab4a-0bb4-48e0-a9d4-81ddddac370d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Request method failure captured: May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 HTTP/1.1 May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oGuJTQ6f-IDwTayqsmyEuiYZCyCBghj4J4gRidpvDCVd0Eg3Sj9ajI5qX6D-1qiP3ad5LMk2NiajKCg1Y2vUCT157yb_wSUVBAooPjR8rGomc11eGRNqsOysOpFJR73EiOfIfV5xEZYROH9vNQ5vSEA-GHlj46_BuLvi1doHfnuWs May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:17.206029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 2b2af35e12fc477387b443dd768274f4 May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '1a38f108-2276-43c3-8364-4f0515be61d0'} May 11 06:39:17.207240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. (HTTP 404) (Request-ID: req-f476863f-380c-4c0d-b392-24cecb5a9587) May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.208040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:17.209005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:39:17.210036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.211065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.213513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08a4ab4a-0bb4-48e0-a9d4-81ddddac370d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Returning 404 to user: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:17.217653 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-08a4ab4a-0bb4-48e0-a9d4-81ddddac370d tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 404 len: 109 microversion: 2.1 time: 0.100688 May 11 06:39:17.218373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 10/24] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:17 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:17.237570 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2c6ee15-e1de-4450-a66f-574a22970ada tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c98ae430>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:17.266608 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:17.291080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-d2c6ee15-e1de-4450-a66f-574a22970ada tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] HTTP exception thrown: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2c6ee15-e1de-4450-a66f-574a22970ada tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Request method failure captured: May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 HTTP/1.1 May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oGuJTQ6f-IDwTayqsmyEuiYZCyCBghj4J4gRidpvDCVd0Eg3Sj9ajI5qX6D-1qiP3ad5LMk2NiajKCg1Y2vUCT157yb_wSUVBAooPjR8rGomc11eGRNqsOysOpFJR73EiOfIfV5xEZYROH9vNQ5vSEA-GHlj46_BuLvi1doHfnuWs May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:17.294172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 2b2af35e12fc477387b443dd768274f4 May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '1a38f108-2276-43c3-8364-4f0515be61d0'} May 11 06:39:17.295440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. (HTTP 404) (Request-ID: req-861ef32d-c927-4703-93e9-faa8e1402163) May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.296128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:17.297303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:39:17.298597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.299676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.301797 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2c6ee15-e1de-4450-a66f-574a22970ada tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Returning 404 to user: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:17.302834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d2c6ee15-e1de-4450-a66f-574a22970ada tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 404 len: 109 microversion: 2.1 time: 0.079075 May 11 06:39:17.303756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 11/25] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:39:17 2022] DELETE /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:17.315505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f75388b5-7fc1-4852-8c78-8bfdb21a6454 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1285 microversion: 2.1 time: 0.626409 May 11 06:39:17.317692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 15/26] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:16 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1285 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:17.322040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-07f023cb-acb9-47b8-8e78-f5f7b92df1ca tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Calling method '.version_select at 0x7fc5c999b670>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:17.407035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-07f023cb-acb9-47b8-8e78-f5f7b92df1ca tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] HTTP exception thrown: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-07f023cb-acb9-47b8-8e78-f5f7b92df1ca tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Request method failure captured: May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 HTTP/1.1 May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oGuJTQ6f-IDwTayqsmyEuiYZCyCBghj4J4gRidpvDCVd0Eg3Sj9ajI5qX6D-1qiP3ad5LMk2NiajKCg1Y2vUCT157yb_wSUVBAooPjR8rGomc11eGRNqsOysOpFJR73EiOfIfV5xEZYROH9vNQ5vSEA-GHlj46_BuLvi1doHfnuWs May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:17.412591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a8541ea614a44ce7b0bec785f723849f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: a8541ea614a44ce7b0bec785f723849f May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1844171325 May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 2b2af35e12fc477387b443dd768274f4 May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1844171325-project May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '1a38f108-2276-43c3-8364-4f0515be61d0'} May 11 06:39:17.413690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. (HTTP 404) (Request-ID: req-abef20a0-0380-4130-8ce2-92afe2cd2de1) May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.414370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:17.415223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:39:17.416160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. May 11 06:39:17.417011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:17.420318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-07f023cb-acb9-47b8-8e78-f5f7b92df1ca tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] Returning 404 to user: Volume 1a38f108-2276-43c3-8364-4f0515be61d0 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:17.425002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-07f023cb-acb9-47b8-8e78-f5f7b92df1ca tempest-VolumesSnapshotsTestJSON-1844171325 tempest-VolumesSnapshotsTestJSON-1844171325-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0" status: 404 len: 109 microversion: 2.1 time: 0.113266 May 11 06:39:17.426426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 12/27] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:17 2022] GET /compute/v2.1/os-volumes/1a38f108-2276-43c3-8364-4f0515be61d0 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:17.639139 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1893526613", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:17.789479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] validate_networks() for [('f58da4c7-ef95-435b-ab0f-347f8d529b37', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:39:18.334605 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:18.336151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:18.361988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:18.365213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:18.370864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:18.372869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:19.043631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:19.054851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-79e8facc-63c2-4ffc-9071-f62cfe4a259d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1273 microversion: 2.1 time: 0.725735 May 11 06:39:19.069397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 13/28] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:18 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1273 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:20.080473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:20.084095 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:20.116020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:20.119835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:20.126402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:20.129286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:21.298708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:21.325904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8e0c7897-bbaa-4d35-b84b-1521e448e13d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 1.256781 May 11 06:39:21.335815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 14/29] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:20 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:22.157314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:39:22.157891 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:39:22.158637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:39:22.159226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:39:22.159964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:39:22.177369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:22.179985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:22.181078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:22.182581 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:22.246113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:22.258435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for user 0334273a56994a7abfa3d72006f7a7a4 and project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:22.308439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:39:22.320234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:39:22.348184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:22.349657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:22.379535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:22.382284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:22.387963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:22.390447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:22.555324 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-30185a0e-bfcf-4a39-83c8-b8bf17c0e5ca tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.161280 May 11 06:39:22.558217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 16/30] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:39:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 5166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:39:22.596641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ea717a73-d968-4ef5-bb8b-e1d68e7d8d71 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:22.599535 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ea717a73-d968-4ef5-bb8b-e1d68e7d8d71 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:22.850621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ea717a73-d968-4ef5-bb8b-e1d68e7d8d71 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:22.860742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ea717a73-d968-4ef5-bb8b-e1d68e7d8d71 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1222 microversion: 2.1 time: 0.294506 May 11 06:39:22.892009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:22 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1222 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:23.265896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:23.274533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c63a0be8-3dc0-443e-9a06-6eefda2fc874 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.933541 May 11 06:39:23.285037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 15/32] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:22 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:23.307296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-124936788", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:23.466934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] validate_networks() for [('f58da4c7-ef95-435b-ab0f-347f8d529b37', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:39:24.301001 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:24.301714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:24.328887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:24.331941 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:24.335214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:24.337735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:25.717236 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:25.724989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fd38a680-893f-49be-b3e8-34365d75f135 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 1.431691 May 11 06:39:25.727639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:24 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:25.811086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:39:25.828338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:39:25.829278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:39:25.829721 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:39:25.830149 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:39:25.899542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:25.900002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:25.910039 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:25.910825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:25.979172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:25.999589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for user 0334273a56994a7abfa3d72006f7a7a4 and project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:26.047579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:39:26.049711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:39:26.054962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1127802446", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e699df-3755-47eb-b019-c5436429fdb7"}], "security_groups": [{"name": "tempest-securitygroup--996858386"}], "key_name": "tempest-keypair-651770994", "user_data": "}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:26.281792 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c8e4dbbb-87fb-47bb-85ff-2800d732bc66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.978630 May 11 06:39:26.290265 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 18/34] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:39:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:39:26.303005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-429a9014-e9c7-43ae-9f75-dba507946d8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:26.303900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-429a9014-e9c7-43ae-9f75-dba507946d8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:26.789056 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-429a9014-e9c7-43ae-9f75-dba507946d8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:26.799068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-429a9014-e9c7-43ae-9f75-dba507946d8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1221 microversion: 2.1 time: 0.507262 May 11 06:39:26.811726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 19/35] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:26 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1221 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:26.872212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] validate_networks() for [('61e699df-3755-47eb-b019-c5436429fdb7', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:39:27.253352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eba5b1b0-a3aa-4f0c-8f32-d7fed6591bf2 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Action: 'create', calling method: .version_select at 0x7fc5ca08cd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-633947480", "metadata": {"Type": "work"}}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:28.361007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eba5b1b0-a3aa-4f0c-8f32-d7fed6591bf2 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.547421 May 11 06:39:28.362602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 20/36] 10.222.0.64 () {60 vars in 1155 bytes} [Wed May 11 06:39:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1549 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 06:39:28.367736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:28.368897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:28.381489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:28.382287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:28.383241 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:28.383851 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:29.318639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:39:29.319143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:39:29.319546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:39:29.320158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:39:29.320624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:39:29.357481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:29.363692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:29.372148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:29.373831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:29.450208 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:29.461109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:29.487250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:39:29.490318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:39:29.603389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5d4dacb9-3ca4-494d-beee-10f738e09c67 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.554758 May 11 06:39:29.606799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 17/37] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:39:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 3561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:39:29.618220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:29.618476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:29.620193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:29.630044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9b94af04-b1ad-48dc-8a23-42dba981d025 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 1.263568 May 11 06:39:29.635639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:29.637529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:29.638646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:29.640045 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:29.647087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 21/38] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:28 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:29.653311 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-12406b36-09d4-4499-9167-07b200ce472f tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5ca0b3af0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:29.804869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-12406b36-09d4-4499-9167-07b200ce472f tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 200 len: 353 microversion: 2.1 time: 0.156179 May 11 06:39:29.805980 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 22/39] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:29 2022] GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:29.974262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-a52ec209-8113-44c9-9c6b-c06732724103 req-616d2043-7992-4565-816c-1f470f8835bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6edb4e8f-f617-4c28-ac15-600d89a37341", "tag": "8f2b511e-a9e7-4379-8934-794a6bb1007d"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:30.013393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-a52ec209-8113-44c9-9c6b-c06732724103 req-616d2043-7992-4565-816c-1f470f8835bb service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:30.013845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-a52ec209-8113-44c9-9c6b-c06732724103 req-616d2043-7992-4565-816c-1f470f8835bb service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:30.076991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-a52ec209-8113-44c9-9c6b-c06732724103 req-616d2043-7992-4565-816c-1f470f8835bb service nova] Creating event network-changed:8f2b511e-a9e7-4379-8934-794a6bb1007d for instance 6edb4e8f-f617-4c28-ac15-600d89a37341 on hv-cinder-80475 May 11 06:39:30.077986 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-a52ec209-8113-44c9-9c6b-c06732724103 req-616d2043-7992-4565-816c-1f470f8835bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=128923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 06:39:30.079691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:30.080892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:30.083294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:30.084453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:30.095739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.compute.rpcapi [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 06:39:30.098166 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] Releasing lock "compute-rpcapi-router" {{(pid=128923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 06:39:30.166527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9326879e-0ecc-4de1-b59a-574db20f20f9 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358353 May 11 06:39:30.167494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 23/40] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:30.172885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-00df6b8a-1c4a-4f82-8f5d-33cb5635532a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:30.173788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-00df6b8a-1c4a-4f82-8f5d-33cb5635532a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:30.301146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:30.313037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-76443027-5fb4-4f45-8e0d-101cbf2a829b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1279 microversion: 2.1 time: 0.704723 May 11 06:39:30.317318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 18/41] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:29 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1279 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:30.337023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-59404fde-101c-49e1-829b-13b28a41f8b6 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5c9876040>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:30.479524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-59404fde-101c-49e1-829b-13b28a41f8b6 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 200 len: 353 microversion: 2.1 time: 0.150453 May 11 06:39:30.481459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-00df6b8a-1c4a-4f82-8f5d-33cb5635532a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:30.481962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 19/42] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:30 2022] GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:30.492558 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2117126537", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db82dec6-6180-4aae-84ec-afed65e8ca62"}], "security_groups": [{"name": "tempest-securitygroup--485245742"}], "key_name": "tempest-keypair-1330297397", "user_data": "}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:30.495488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-00df6b8a-1c4a-4f82-8f5d-33cb5635532a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1241 microversion: 2.1 time: 0.326541 May 11 06:39:30.496164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 24/43] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:30 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1241 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:30.534530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-97a61482-f365-4ceb-b660-34611b9f03af tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5ca0b6820>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:30.734625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-97a61482-f365-4ceb-b660-34611b9f03af tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 202 len: 0 microversion: 2.1 time: 0.219669 May 11 06:39:30.735292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 25/44] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:39:30 2022] DELETE /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:39:30.744908 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:30.747824 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:30.768323 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:30.773727 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:30.779500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:30.782761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:30.960117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] validate_networks() for [('db82dec6-6180-4aae-84ec-afed65e8ca62', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:39:31.331250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:31.343532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9d9f4475-2599-49d9-a89a-f2df0167a729 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.606935 May 11 06:39:31.344835 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 26/45] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:30 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:31.356958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-63926583-f581-4591-81ce-8a32a55cf5b8 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5ca0b6280>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:31.459569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-63926583-f581-4591-81ce-8a32a55cf5b8 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 200 len: 352 microversion: 2.1 time: 0.113241 May 11 06:39:31.460893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 27/46] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:31 2022] GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:31.467040 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:31.467884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:31.482923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.483462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.486498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.486962 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.672107 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:31.688014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eaf90736-0b7b-4195-8894-b6ea42a476ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1279 microversion: 2.1 time: 0.224395 May 11 06:39:31.698781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 28/47] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:31 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:31.700177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:31.700804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:31.715091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.715599 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.716375 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.716814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.833354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:31.842147 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e99b720f-20a0-4545-b507-a4da67d7a236 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1245 microversion: 2.1 time: 0.150971 May 11 06:39:31.843372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 29/48] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:31 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:31.845332 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:39:31.845795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:39:31.846214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:39:31.847091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:39:31.847705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:39:31.859231 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.859767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.860637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:31.861130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:31.888086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for project ea42234bb6844ce88afe0725d859863e. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:39:31.892044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for user 1f2d12e60ae147198c3940c510616285 and project ea42234bb6844ce88afe0725d859863e. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:39:31.916653 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:39:31.921516 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:39:31.985552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3927c723-16cf-4128-860d-194531b9a0d8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.500337 May 11 06:39:31.991232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 20/49] 10.222.0.64 () {62 vars in 1187 bytes} [Wed May 11 06:39:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 06:39:31.998217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:31.998773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:32.106749 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.116798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.122140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.123420 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bf994a1b-839c-4260-903a-5a5461fe445c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1282 microversion: 2.20 time: 0.130874 May 11 06:39:32.126669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 30/50] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:31 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:32.361487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:32.362152 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:32.369102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.369557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.370329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.370776 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.472882 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1c6d15cc-c588-4b1b-aa2a-25d36e922425 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5ca0b3160>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:32.530279 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1c6d15cc-c588-4b1b-aa2a-25d36e922425 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 200 len: 352 microversion: 2.1 time: 0.061599 May 11 06:39:32.531338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 31/51] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:32 2022] GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:32.538783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.548722 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-88a30bb9-7348-4748-9bcd-aad89da8ab23 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.191709 May 11 06:39:32.549902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 21/52] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:32 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:32.706586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:32.707598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:32.720125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.720692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.721516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.721969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.792685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.814718 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a5ecfdf2-24e4-427f-b439-83f664154f8e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1279 microversion: 2.1 time: 0.104375 May 11 06:39:32.816743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 32/53] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:32 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:32.860226 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:32.861473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:32.868016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.868463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.869417 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:32.869883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:32.950915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:32.958686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc5eb955-5072-4ad7-b9c6-d073a578432b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1245 microversion: 2.1 time: 0.103786 May 11 06:39:32.968888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 22/54] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:32 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:33.143518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:33.144765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:33.160759 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.161583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.164243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.165119 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.335318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:33.350006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:33.352049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:33.354266 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-24cc0a15-2425-4a1e-af0e-89842c37bd19 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1286 microversion: 2.20 time: 0.215628 May 11 06:39:33.355301 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 33/55] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:33 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:33.543705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2344d727-912c-4093-baae-9106e269ff12 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Calling method '.version_select at 0x7fc5c8fbc4c0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:33.565813 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:33.566707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:33.583756 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.584736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.586858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.587629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.603720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-2344d727-912c-4093-baae-9106e269ff12 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] HTTP exception thrown: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2344d727-912c-4093-baae-9106e269ff12 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Request method failure captured: May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 HTTP/1.1 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oecnIdoclfnX_fxaXCQhSpgjiA598j_xkK6luyqbB1x2BwhJr39bSetM2-9ORkoF8gkD_kugKASvvKQuXq9nqhRtHqwo4gpYaNYzCTbJH0YZ1tbmfhNBdF7Sf9kohyDUzXiqIPBygrIuGuUqIhwNON4Sl2qBGKdb2JEoAWnndLDyw May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 6a8da625dd924ffabe01e2d90d1c98a8 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesGetTestJSON-1496706963 May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:33.606489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a8da625dd924ffabe01e2d90d1c98a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a8da625dd924ffabe01e2d90d1c98a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a8da625dd924ffabe01e2d90d1c98a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a8da625dd924ffabe01e2d90d1c98a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesGetTestJSON-1496706963 May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 6a8da625dd924ffabe01e2d90d1c98a8 May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesGetTestJSON-1496706963 May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesGetTestJSON-1496706963-project May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: db7af847092949699952ff91f0fecaad May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesGetTestJSON-1496706963-project May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '1a9c279e-3278-4052-a854-f58ff2e1b3c0'} May 11 06:39:33.607704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. (HTTP 404) (Request-ID: req-968dd858-a021-4506-9914-dec5d2005aaf) May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:33.608437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:33.609440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:39:33.610381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. May 11 06:39:33.611420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:33.614348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2344d727-912c-4093-baae-9106e269ff12 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] Returning 404 to user: Volume 1a9c279e-3278-4052-a854-f58ff2e1b3c0 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:33.615461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2344d727-912c-4093-baae-9106e269ff12 tempest-VolumesGetTestJSON-1496706963 tempest-VolumesGetTestJSON-1496706963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0" status: 404 len: 109 microversion: 2.1 time: 0.076366 May 11 06:39:33.616217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 23/56] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:33 2022] GET /compute/v2.1/os-volumes/1a9c279e-3278-4052-a854-f58ff2e1b3c0 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:33.845812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:33.846815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:33.874068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.874684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.880062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.880624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.911041 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:33.918940 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2919f0c8-7b1b-41e9-ab2c-5b87c8fd75c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.356374 May 11 06:39:33.932546 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 34/57] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:33 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:33.977964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:33.978605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:33.986372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.986836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:33.987675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:33.988120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:34.003709 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:34.015932 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-32a67457-59fb-4667-afe0-2a2f011afb66 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1279 microversion: 2.1 time: 0.174295 May 11 06:39:34.017714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 24/58] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:33 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:34.122453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:34.158352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b5d22b30-052c-44b1-b529-f3aabcee2118 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1245 microversion: 2.1 time: 0.184244 May 11 06:39:34.173601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 35/59] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:33 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:34.378070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:34.378647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:34.409548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:34.411584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:34.415675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:34.416264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:34.642545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:34.654411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:34.656033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:34.663392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a7255b53-dffa-41c5-9e57-eb2abbdf3ab7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1286 microversion: 2.20 time: 0.289838 May 11 06:39:34.664790 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 25/60] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:34 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1286 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:34.940715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:34.941361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:34.947446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:34.948174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:34.948967 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:34.950064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.034448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:35.035057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:35.041229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.041676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.042438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.043075 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.125068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.133050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-89596df1-283a-4200-b4d9-900b3d5940e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1279 microversion: 2.1 time: 0.102344 May 11 06:39:35.134165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 26/61] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:35 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:35.175630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:35.176369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:35.186508 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.193066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.193893 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.194342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.231902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.264076 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-62f8bd14-999d-41fd-8bb4-edca6e1bd7ba tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.322796 May 11 06:39:35.270328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 36/62] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:34 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:35.414065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.428302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-90950d79-f0cb-4e61-b406-82a818558b8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.256877 May 11 06:39:35.429283 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 27/63] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:35 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:35.690329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:35.691037 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:35.712615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.718883 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.721135 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:35.722143 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:35.853706 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.863985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.865730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:35.879763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-99c9274d-0ad2-4720-9afd-0b8f07fef3e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1334 microversion: 2.20 time: 0.196625 May 11 06:39:35.881387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 37/64] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:35 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1334 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:36.150199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.150865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:36.159893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.160348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.161132 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.161573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.177293 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-19c017fa-7204-4966-b2ec-bb4d41235d8e req-522e795e-b5f2-409b-bca1-fe9dcf4a8b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915", "tag": "f96eb40a-ee8f-4854-a24e-26c491a5b3ea"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:36.193686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-19c017fa-7204-4966-b2ec-bb4d41235d8e req-522e795e-b5f2-409b-bca1-fe9dcf4a8b65 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.194340 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-19c017fa-7204-4966-b2ec-bb4d41235d8e req-522e795e-b5f2-409b-bca1-fe9dcf4a8b65 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.226456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-19c017fa-7204-4966-b2ec-bb4d41235d8e req-522e795e-b5f2-409b-bca1-fe9dcf4a8b65 service nova] Creating event network-changed:f96eb40a-ee8f-4854-a24e-26c491a5b3ea for instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 on hv-cinder-80475 May 11 06:39:36.231996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-19c017fa-7204-4966-b2ec-bb4d41235d8e req-522e795e-b5f2-409b-bca1-fe9dcf4a8b65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 06:39:36.233442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.235501 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.239518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.240379 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.255734 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.compute.rpcapi [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 06:39:36.258036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-05a78ae2-d833-425a-8000-131b4821257e None None] Releasing lock "compute-rpcapi-router" {{(pid=128924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 06:39:36.295319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-05a78ae2-d833-425a-8000-131b4821257e None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273328 May 11 06:39:36.301855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 28/65] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:36.309381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.310268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:36.316851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.317509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.318472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.319062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.349233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:36.357244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0f9313ac-f8ff-47b1-8ad7-c64c3b321c64 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.210799 May 11 06:39:36.368057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 38/66] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:36.472673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:36.483747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-016ef851-d7a7-49a0-86f3-1912f694445d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.178616 May 11 06:39:36.487615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 29/67] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:36.492470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.493420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:36.500509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.501093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.502230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.502669 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.559355 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fec50128-1f77-4ce5-a09b-fa961d8e4f10 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Action: 'create', calling method: .version_select at 0x7fc5c904aca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-375687003", "metadata": {"Type": "work"}}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fec50128-1f77-4ce5-a09b-fa961d8e4f10 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 121 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:39:36.569358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-375687003", "metadata": {"Type": "work"}}} May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: May 11 06:39:36.570801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-375687003', 'metadata': {'Type': 'work'}}}} May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise error May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi '#$%' May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.571686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:39:36.573314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:39:36.575007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:39:36.575007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.575007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fec50128-1f77-4ce5-a09b-fa961d8e4f10 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.575007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fec50128-1f77-4ce5-a09b-fa961d8e4f10 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179860 May 11 06:39:36.575681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 39/68] 10.222.0.64 () {60 vars in 1155 bytes} [Wed May 11 06:39:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 06:39:36.585466 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d90243dc-e23d-4b4f-bcb8-03524d5b684c tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Action: 'create', calling method: .version_select at 0x7fc5ca0b3790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-816706198", "metadata": {"Type": "work"}}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d90243dc-e23d-4b4f-bcb8-03524d5b684c tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 119 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:39:36.588033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-816706198", "metadata": {"Type": "work"}}} May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: May 11 06:39:36.589364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-816706198', 'metadata': {'Type': 'work'}}}} May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise error May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi '0' May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.590738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:39:36.591979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:39:36.593123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:39:36.593123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.593275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:36.593823 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d90243dc-e23d-4b4f-bcb8-03524d5b684c tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.594875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d90243dc-e23d-4b4f-bcb8-03524d5b684c tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013542 May 11 06:39:36.600540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 40/69] 10.222.0.64 () {60 vars in 1155 bytes} [Wed May 11 06:39:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:39:36.604717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-44fed3f0-81b2-4e3e-b9a8-acfab69833fc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.115768 May 11 06:39:36.605333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 30/70] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:36.607367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7a8b9d88-472e-4177-814d-14d993ac1d82 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Action: 'create', calling method: .version_select at 0x7fc5cac2dd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1718425269", "metadata": {"Type": "work"}}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7a8b9d88-472e-4177-814d-14d993ac1d82 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 119 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:39:36.609775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1718425269", "metadata": {"Type": "work"}}} May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: May 11 06:39:36.611079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1718425269', 'metadata': {'Type': 'work'}}}} May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise error May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi '' May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.611938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:39:36.613275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:39:36.614438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:39:36.614438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.614981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7a8b9d88-472e-4177-814d-14d993ac1d82 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.615938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7a8b9d88-472e-4177-814d-14d993ac1d82 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013219 May 11 06:39:36.616600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 41/71] 10.222.0.64 () {60 vars in 1155 bytes} [Wed May 11 06:39:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:39:36.626184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5d7d2fa-49c7-496f-a40e-22d8c61cfffc tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Calling method '.version_select at 0x7fc5c9876040>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.663534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-f5d7d2fa-49c7-496f-a40e-22d8c61cfffc tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] HTTP exception thrown: Volume tempest-invalid-356307009 could not be found. May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5d7d2fa-49c7-496f-a40e-22d8c61cfffc tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-356307009 HTTP/1.1 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:39:36.668861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Volume tempest-invalid-356307009 could not be found. May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'tempest-invalid-356307009'} May 11 06:39:36.670014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-356307009 could not be found. (HTTP 404) (Request-ID: req-99e77e97-8745-4e3d-b730-9fb7cf8e9f31) May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.670659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:36.671807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-356307009 could not be found. May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:36.674309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-356307009 could not be found. May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-356307009 could not be found. May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5d7d2fa-49c7-496f-a40e-22d8c61cfffc tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 404 to user: Volume tempest-invalid-356307009 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f5d7d2fa-49c7-496f-a40e-22d8c61cfffc tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-356307009" status: 404 len: 98 microversion: 2.1 time: 0.049099 May 11 06:39:36.677064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 31/72] 10.222.0.64 () {58 vars in 1214 bytes} [Wed May 11 06:39:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-356307009 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 11 06:39:36.681019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1b2b7f78-7371-40a6-9c54-ae1283454670 tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003737 May 11 06:39:36.681711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 42/73] 10.222.0.64 () {58 vars in 1139 bytes} [Wed May 11 06:39:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 06:39:36.692160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c825284c-2b66-4098-8bdd-17cc990b677e tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004572 May 11 06:39:36.702541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-701f582e-8153-4fbd-8f5f-9e829dc8568a tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Calling method '.version_select at 0x7fc5ca0b3c10>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.707329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 32/74] 10.222.0.64 () {58 vars in 1136 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 06:39:36.716083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-eb735825-b05e-49e1-8284-87eb81c67f8e req-f6b198db-8539-4841-a5c0-5ab7f3b589b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8c818b-6fff-427f-bab8-3f96e99bb236", "tag": "23e63531-0e9d-493d-ac18-7001469a18bd"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:36.731818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-701f582e-8153-4fbd-8f5f-9e829dc8568a tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] HTTP exception thrown: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. May 11 06:39:36.732806 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-eb735825-b05e-49e1-8284-87eb81c67f8e req-f6b198db-8539-4841-a5c0-5ab7f3b589b0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.735219 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-eb735825-b05e-49e1-8284-87eb81c67f8e req-f6b198db-8539-4841-a5c0-5ab7f3b589b0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-701f582e-8153-4fbd-8f5f-9e829dc8568a tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/os-volumes/06c97c1b-e61f-4e90-8449-b6328ffee313 HTTP/1.1 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:39:36.735542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '06c97c1b-e61f-4e90-8449-b6328ffee313'} May 11 06:39:36.736843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. (HTTP 404) (Request-ID: req-1119a304-252e-46aa-a254-c1ed2f76b09f) May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.737622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:39:36.738741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:39:36.739761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-701f582e-8153-4fbd-8f5f-9e829dc8568a tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 404 to user: Volume 06c97c1b-e61f-4e90-8449-b6328ffee313 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.740802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-701f582e-8153-4fbd-8f5f-9e829dc8568a tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/06c97c1b-e61f-4e90-8449-b6328ffee313" status: 404 len: 109 microversion: 2.1 time: 0.039136 May 11 06:39:36.742870 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 43/75] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:39:36 2022] DELETE /compute/v2.1/os-volumes/06c97c1b-e61f-4e90-8449-b6328ffee313 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:36.747491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e233fcc3-aa54-4877-9f63-61818631c20b tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Calling method '.version_select at 0x7fc5c904a5e0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.776222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-e233fcc3-aa54-4877-9f63-61818631c20b tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] HTTP exception thrown: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e233fcc3-aa54-4877-9f63-61818631c20b tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Request method failure captured: May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/os-volumes/536b8734-24df-451d-b254-d125c7cca8ba HTTP/1.1 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ooJzDrPbSjuOsgypurhHopSkR-BSpXZg-DTJ3cIApYOu3ENofvAeqRnd9y-qTjF1KX2ucXfS0bR114dzLdnt9YC7tWc3ByTggecoPTpnLzbZqma_kSelqM1RQmoDnSJv1in71vzMvb9QtPQ_9pPKOOwWaIQQkivAa0mfpklHrtSZw May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:39:36.778434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ffaa9f28aa2420196dabde6a5daa0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ffaa9f28aa2420196dabde6a5daa0e1 May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-1670173270 May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f253c7e75d334629a745eb524dca9177 May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-1670173270-project May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '536b8734-24df-451d-b254-d125c7cca8ba'} May 11 06:39:36.779726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. (HTTP 404) (Request-ID: req-2cccc574-fb43-4997-a990-00cdd2cd91fa) May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.780372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:39:36.781306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:39:36.782314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. May 11 06:39:36.783394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:39:36.784828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e233fcc3-aa54-4877-9f63-61818631c20b tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] Returning 404 to user: Volume 536b8734-24df-451d-b254-d125c7cca8ba could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:39:36.785675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e233fcc3-aa54-4877-9f63-61818631c20b tempest-VolumesNegativeTest-1670173270 tempest-VolumesNegativeTest-1670173270-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/536b8734-24df-451d-b254-d125c7cca8ba" status: 404 len: 109 microversion: 2.1 time: 0.042567 May 11 06:39:36.785789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-eb735825-b05e-49e1-8284-87eb81c67f8e req-f6b198db-8539-4841-a5c0-5ab7f3b589b0 service nova] Creating event network-changed:23e63531-0e9d-493d-ac18-7001469a18bd for instance ce8c818b-6fff-427f-bab8-3f96e99bb236 on hv-cinder-80475 May 11 06:39:36.790627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-eb735825-b05e-49e1-8284-87eb81c67f8e req-f6b198db-8539-4841-a5c0-5ab7f3b589b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079989 May 11 06:39:36.791459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 33/76] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:36.794700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 44/77] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/os-volumes/536b8734-24df-451d-b254-d125c7cca8ba => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:39:36.898778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:36.899573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:36.905981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.906518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.908029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:36.908541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:36.997171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.005376 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.006888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.008248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-35c07207-dbe1-4967-80cc-61e5d61f52f2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.114041 May 11 06:39:37.008943 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 45/78] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:36 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:37.384695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:37.385389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:37.392276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.392729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.393492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.393922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.503686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:37.504297 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:37.510456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.510973 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.512042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.512538 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.637119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.657054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5b0516ed-17f3-4292-aac6-bac09eba206a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.276264 May 11 06:39:37.657805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 34/79] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:37 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:37.673728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:37.674331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:37.681770 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.682216 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.682986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:37.683471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:37.723626 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.732534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-266445c2-5978-4394-a164-84b71f4b0bfa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.230523 May 11 06:39:37.733457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 46/80] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:37 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:37.765482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:37.773926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b36b6ae5-a6d9-431d-a520-eb59ae676c30 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.104661 May 11 06:39:37.774498 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 35/81] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:37 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:38.028200 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:38.029056 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:38.037286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.037921 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.038693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.039116 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.110825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:38.118522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:38.120055 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:38.121406 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e9b2a07f-019d-4d30-9764-1aada8541101 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.098091 May 11 06:39:38.122036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 47/82] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:38 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:38.678128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:38.679248 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:38.686262 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.686889 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.688264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.688950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.752673 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:38.753289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:38.760053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.760808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.761632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.763982 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.916751 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:38.925796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7836d5f4-59f6-4edc-99fd-47175c111541 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.255155 May 11 06:39:38.927389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 36/83] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:38 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:38.934180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:38.936034 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:38.942900 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.943559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.944922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:38.945450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:38.959601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:38.967052 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5f15235a-90c5-4dc5-925b-a7729215c850 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.221926 May 11 06:39:38.967672 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 48/84] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:38 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:39.025119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:39.033387 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fda40324-0b75-4bbf-a6fb-a853a288b6c7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.104825 May 11 06:39:39.034076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 37/85] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:38 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:39.140678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:39.141426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:39.149449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.149801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:39.150876 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.151591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:39.227436 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:39.237133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:39.238860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:39.240002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2e8b074d-d658-4f20-b5c2-d3ee99a7c055 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.103433 May 11 06:39:39.240541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 49/86] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:39 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:39.944100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:39.944703 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:39.950733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.951185 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:39.951971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.952403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:39.985896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:39.986587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:39.993091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.993615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:39.994585 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:39.995215 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:40.131787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.139746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da8f9fde-b442-45d9-adf5-d87cafd0ca2b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.199669 May 11 06:39:40.140447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 38/87] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:39 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:40.145204 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:40.145887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:40.155488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:40.155488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:40.155488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:40.155488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:40.163475 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.171022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a4555912-810c-4b76-b9ad-baecdc84c8fc tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.189119 May 11 06:39:40.174575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 50/88] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:39 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:40.218127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.225357 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3a41ccb7-6e67-44c4-9da0-2ef9194fc45d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.083683 May 11 06:39:40.225930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 39/89] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:40 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:40.262486 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:40.263511 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:40.269595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:40.270184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:40.271134 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:40.271637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:40.333209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.342307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.343825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:40.344918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-183dc9dc-1e42-4c90-9613-cf8d696b41b7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.086961 May 11 06:39:40.345470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 51/90] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:40 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:41.158851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:41.159630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:41.165546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.165997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.166748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.167180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.190102 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:41.190714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:41.196685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.197139 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.198186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.198619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.367799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.374500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.375117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1a129f20-1e27-48da-9541-bd36a5910b72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.220111 May 11 06:39:41.375760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 40/91] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:41 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:41.380366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:41.380969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:41.382137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8d53edc4-e023-4787-8215-d901a97988a7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.195865 May 11 06:39:41.382929 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 52/92] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:41 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:41.386614 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.387174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.387868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:41.388217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.388705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:41.388803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.394398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.394849 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.395635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:41.396075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:41.472161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.473744 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.479496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aea6a1d4-0c85-4344-953c-d0de708fdced tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.102744 May 11 06:39:41.480976 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 41/93] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:41 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:41.482136 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.483685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:41.484792 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9ff703e2-49d3-4618-bedb-d55c71606f95 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.100342 May 11 06:39:41.485336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 53/94] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:41 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:42.391801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:42.392415 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:42.398804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.399001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:42.399423 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.399639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:42.400054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.400531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.405481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.405925 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.406695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.407125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.602434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.607968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.617397 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-549be925-b308-4636-9e05-1942a71c5569 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.222131 May 11 06:39:42.618065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 54/95] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:42 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:42.618905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2313185d-64f7-4f91-b674-85d094286369 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.230850 May 11 06:39:42.619816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 42/96] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:42 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:42.624815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:42.625410 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:42.631190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.631670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.632431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.632867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.633706 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:42.634397 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:42.640934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.641386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.642213 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:42.642601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:42.724831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.725483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.733916 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9dbbc85d-8cdf-4621-92c7-844b4e8570c3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1293 microversion: 2.1 time: 0.114769 May 11 06:39:42.734478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.734743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 55/97] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:42 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:42.736322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:42.737953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c369166a-e315-4f8a-843b-9f1503b52cfc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1342 microversion: 2.20 time: 0.116583 May 11 06:39:42.738149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 43/98] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:42 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:43.634807 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:43.635443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:43.636303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:43.637769 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:43.642413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.643120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.643696 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.644094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.644199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.644530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.644898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.645328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.834186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.837053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.842093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2191dba7-ab4f-4d83-9dcc-494126fe66f6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.209583 May 11 06:39:43.842899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 44/99] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:43 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:43.844365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-06bab87d-3815-4d25-bfd8-c4ee2957369c tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.214460 May 11 06:39:43.844919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 56/100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:43 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:43.849687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:43.850383 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:43.857981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.857981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.858173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:43.858572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.858767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:43.859067 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.864562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.865010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.865775 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:43.866213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:43.942965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.944512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.951057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.951781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7d9573cf-7a18-49e3-b617-afc484988839 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1301 microversion: 2.1 time: 0.107691 May 11 06:39:43.952346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 45/101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:43 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:43.952720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:43.953812 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d691b61a-7d10-443b-b78c-4b7fe90ce070 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1352 microversion: 2.20 time: 0.107869 May 11 06:39:43.954361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 57/102] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:43 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:44.857557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:44.858161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:44.860728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:44.861346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:44.865752 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:44.866141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:44.866911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:44.867367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:44.869362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:44.870088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:44.872506 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:44.873184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:45.054460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.061509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.062285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2690b665-cffb-49dd-b0cf-b939794229da tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.208433 May 11 06:39:45.062853 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 46/103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:44 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:45.067227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:45.067843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:45.068957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8ec7e5e7-afee-4628-8b18-5d79a66e7035 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.212109 May 11 06:39:45.069656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 58/104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:44 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:45.073663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:45.074713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:45.075488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:45.075919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:45.082817 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:45.083472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:45.089492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:45.089944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:45.090704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:45.091132 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:45.141412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.148764 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d9dcc98f-368d-41b6-8f33-3254f7f61e15 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1301 microversion: 2.1 time: 0.084873 May 11 06:39:45.149339 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 47/105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:45 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:45.166716 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.174472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.176016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:45.177102 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-309ccc69-2509-4b1b-b121-9144b7836e13 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1352 microversion: 2.20 time: 0.098050 May 11 06:39:45.177659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 59/106] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:45 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:46.080757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:46.082840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:46.088274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:46.089672 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:46.098957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.099785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.101128 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.101902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.104781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.106848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.110128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.110582 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.440510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.442572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.449564 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c4453389-0fed-4e86-92c1-4856f1db186f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.374289 May 11 06:39:46.451866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-42607e2a-c815-4c7b-a895-41426d8d6964 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.369401 May 11 06:39:46.453636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 60/107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:46 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:46.459897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 48/108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:46 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:46.463542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:46.465012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:46.467212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:46.468028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:46.471703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.472377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.473216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.474254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.475019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.475673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.476612 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:46.477394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:46.567503 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.570724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.575706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.577453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:46.578963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d06f9561-2eaa-4afa-b4a7-6e3939a9053a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1340 microversion: 2.20 time: 0.117798 May 11 06:39:46.590368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 49/109] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:46 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:46.590530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bce8d94f-a373-46e0-ae7d-f077c1b5a2e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1299 microversion: 2.1 time: 0.126497 May 11 06:39:46.590530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 61/110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:46 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:47.466580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:47.467189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:47.468634 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:47.469243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:47.473162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.473607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.474358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.474785 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.475073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.475558 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.476329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.476770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.658669 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.665367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.666049 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62fbc9c8-8876-4c45-97de-8557762cb4d4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.203350 May 11 06:39:47.666614 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 50/111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:47 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:47.671568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:47.672263 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:47.673532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5a9044ce-52fe-4540-a7ce-49cb7f146566 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.208659 May 11 06:39:47.674367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 62/112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:47 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:47.678884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:47.679511 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:47.683235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.684212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.684972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.685432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.685656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.686113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.686878 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:47.687346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:47.769732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.777204 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-37d45625-c1c6-4bf9-9d43-691395644d49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1299 microversion: 2.1 time: 0.101736 May 11 06:39:47.777777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 63/113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:47 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:47.830423 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.837997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.839514 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:47.840601 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a16e62ec-3263-4d34-8eab-c161e616dacf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.173087 May 11 06:39:47.841156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 51/114] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:47 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:48.683834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:48.684377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:48.689892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:48.690611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:48.690718 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.691078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.691892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.692336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.696413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.696858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.697877 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.698311 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.879232 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:48.883314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:48.886733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fa739a60-c5de-41e5-87f9-34d683d96e55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.207159 May 11 06:39:48.887862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 64/115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:48 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:48.891432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-917920cf-2da1-464e-a8f7-6a4933d94b42 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.205189 May 11 06:39:48.892145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 52/116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:48 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:48.892255 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:48.892859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:48.899612 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.899750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:48.900071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.900244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:48.900837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.901275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.905825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.906280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.907050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:48.907510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:48.972594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:48.979926 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-91c3bc57-9d59-4f64-9524-e4ea7f6ba218 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1299 microversion: 2.1 time: 0.091098 May 11 06:39:48.980728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 65/117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:48 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:49.057203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:49.065517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:49.067089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:49.068237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7fe0dca7-51ea-4138-a273-8c0ac7e5f5d5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.172129 May 11 06:39:49.068803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 53/118] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:48 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:49.908598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:49.909831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:49.912152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:49.915667 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:49.922962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:49.923480 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:49.924269 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:49.924714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:49.926904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:49.928120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:49.929308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:49.930190 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:50.574831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:50.586550 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-294982ff-df0d-4499-aa53-82b9c6a90636 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.685804 May 11 06:39:50.593106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 66/119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:49 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:50.608747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:50.611788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:50.627169 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:50.627661 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:50.629464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:50.629934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:50.769292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:50.780212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a6b2541f-7b0a-4a96-a00f-3c0489c5de58 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.875687 May 11 06:39:50.783181 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 54/120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:49 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:50.795970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:50.798533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:50.824875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:50.825299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:50.826083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:50.836456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.174112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.184805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.186818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fdca4ecf-451f-401c-831c-02dfb92d4da3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.588491 May 11 06:39:51.188281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 67/121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:50 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:51.194065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.195952 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.197302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6bc9fec1-2526-4c0d-92d4-118fbdcd484d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.412895 May 11 06:39:51.209145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 55/122] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:50 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:39:51.254312 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-1fb0004d-6233-44c9-b3d3-3c46fdd70818 req-60bc4af5-2d2f-44a5-a8e5-34a40d4432e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6edb4e8f-f617-4c28-ac15-600d89a37341", "name": "network-vif-plugged", "status": "completed", "tag": "8f2b511e-a9e7-4379-8934-794a6bb1007d"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:51.266623 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-1fb0004d-6233-44c9-b3d3-3c46fdd70818 req-60bc4af5-2d2f-44a5-a8e5-34a40d4432e3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.266900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-1fb0004d-6233-44c9-b3d3-3c46fdd70818 req-60bc4af5-2d2f-44a5-a8e5-34a40d4432e3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.271787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-e467ba97-9f92-4b10-9238-8a516f95af79 req-691d55e7-c364-4b1f-bf09-5d117811fd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:51.280934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e467ba97-9f92-4b10-9238-8a516f95af79 req-691d55e7-c364-4b1f-bf09-5d117811fd3d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.281388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e467ba97-9f92-4b10-9238-8a516f95af79 req-691d55e7-c364-4b1f-bf09-5d117811fd3d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.284491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-1fb0004d-6233-44c9-b3d3-3c46fdd70818 req-60bc4af5-2d2f-44a5-a8e5-34a40d4432e3 service nova] Creating event network-vif-plugged:8f2b511e-a9e7-4379-8934-794a6bb1007d for instance 6edb4e8f-f617-4c28-ac15-600d89a37341 on hv-cinder-80475 May 11 06:39:51.291526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-1fb0004d-6233-44c9-b3d3-3c46fdd70818 req-60bc4af5-2d2f-44a5-a8e5-34a40d4432e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101446 May 11 06:39:51.292893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 68/123] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:51.300418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-e467ba97-9f92-4b10-9238-8a516f95af79 req-691d55e7-c364-4b1f-bf09-5d117811fd3d service nova] Creating event network-changed:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:39:51.305774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-e467ba97-9f92-4b10-9238-8a516f95af79 req-691d55e7-c364-4b1f-bf09-5d117811fd3d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037652 May 11 06:39:51.306460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 56/124] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:39:51.604522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:51.606162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:51.612777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.613243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.614041 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.614482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.760077 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.767719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c8732271-ac9b-4707-9b4d-115ac62f6a16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.167158 May 11 06:39:51.769053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 69/125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:51 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:51.799031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:51.799791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:51.806379 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.806828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.807654 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:51.808128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:51.945136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:51.953275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-43727bfc-10e8-41de-9983-76cd281e379b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.158462 May 11 06:39:51.953852 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 57/126] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:51 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:52.203621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:52.204175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:52.210024 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.210468 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.211221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.211670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.216779 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:52.217382 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:52.223052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.223545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.224312 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.224754 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.397901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:52.405995 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-aad988cf-98a4-4129-85af-28ddd61bf02f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.206136 May 11 06:39:52.407061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 70/127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:52 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:52.409660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:52.417481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:52.418955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:52.420068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-578ba552-43cf-4ad9-ba75-9b34aa565a83 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.207914 May 11 06:39:52.420613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 58/128] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:52 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:52.784639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:52.785254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:52.791051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.791536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.792300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.793230 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.915327 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:52.922964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bd407631-52e7-4132-8a72-83deb1b6757b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.142166 May 11 06:39:52.923564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 71/129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:52 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:52.969106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:52.969735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:52.976268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.976734 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:52.977505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:52.977942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.113805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:53.121729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-04a5e53c-8672-4058-9f19-32c4e920e72a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.156371 May 11 06:39:53.122292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 59/130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:52 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:53.345864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-c297d90a-b4fd-49e2-8adc-8b1416c2a8cb req-1eb930c5-1cc1-4007-a502-ef331f4ea56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe36d742-5157-4f04-9f55-02dfafa7d39a", "tag": "c372b82a-d12b-49fe-954d-646c72f56cf5"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:39:53.353963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-c297d90a-b4fd-49e2-8adc-8b1416c2a8cb req-1eb930c5-1cc1-4007-a502-ef331f4ea56f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.354412 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-c297d90a-b4fd-49e2-8adc-8b1416c2a8cb req-1eb930c5-1cc1-4007-a502-ef331f4ea56f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.372404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-c297d90a-b4fd-49e2-8adc-8b1416c2a8cb req-1eb930c5-1cc1-4007-a502-ef331f4ea56f service nova] Creating event network-changed:c372b82a-d12b-49fe-954d-646c72f56cf5 for instance fe36d742-5157-4f04-9f55-02dfafa7d39a on hv-cinder-80475 May 11 06:39:53.377293 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-c297d90a-b4fd-49e2-8adc-8b1416c2a8cb req-1eb930c5-1cc1-4007-a502-ef331f4ea56f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035048 May 11 06:39:53.377891 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 72/131] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:39:53.422898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:53.423545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:53.429462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.429911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.430663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.431097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.438250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:53.438968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:53.444962 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.445418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.446187 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.446625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.622172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:53.625968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:53.629655 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-387d5c15-3a90-42dd-ae3f-a23a16faaa45 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.210488 May 11 06:39:53.630223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 60/132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:53 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:53.634157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:53.635781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:53.637539 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-514fb40d-499a-4083-978b-a3bcf46600ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.203463 May 11 06:39:53.640200 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 73/133] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:53 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:53.941450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:53.942059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:53.948301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.949367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:53.950135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:53.950574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.092543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.099684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e338d20c-9e2f-49bd-92cf-3c32c5804ecf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.162031 May 11 06:39:54.100251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 61/134] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:53 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:54.138346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:54.139012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:54.144881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.145332 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.146131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.146522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.272971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.280144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2a1e3e95-69b9-42bb-8254-4aef9a118186 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.146193 May 11 06:39:54.280778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 74/135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:54 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:54.646857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:54.647488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:54.653898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.654336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.655080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.655531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.656528 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:54.657165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:54.662925 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.663409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.664202 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:54.664666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:54.841772 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.845378 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.849111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c3781a5b-b1a5-4591-b4e8-cf1a65af5a9a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.205861 May 11 06:39:54.849858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 62/136] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:54 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:54.854182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.856518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:54.857656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-15ebcbe6-78cb-4884-b0b0-7cf183eb3986 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.205664 May 11 06:39:54.858274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 75/137] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:54 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:55.116097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:55.116694 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:55.122472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.122915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.123849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.124296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.252910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:55.260221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-307a8af7-9310-450d-94ac-27c6ecb43039 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.147884 May 11 06:39:55.260799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 63/138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:55 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:55.297759 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:55.298358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:55.304163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.304600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.305348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.305774 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.445466 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:55.453697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6f8a9f7a-eb99-4856-a749-7635d2a2bc09 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.160156 May 11 06:39:55.454265 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 76/139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:55 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:55.866088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:55.866622 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:55.873341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.873789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.874557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.874991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.875883 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:55.876492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:55.882253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.882795 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:55.883479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:55.883922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:56.056817 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.063909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.064607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0db8aeec-f7d6-44c2-bd92-20b9561f5b0d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.202347 May 11 06:39:56.065182 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 64/140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:55 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:56.071630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.073523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.074605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fd067327-77be-4833-b6db-9916976f76f9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.203197 May 11 06:39:56.075152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 77/141] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:55 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:56.277360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:56.278446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:56.284286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:56.284733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:56.285483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:56.285913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:56.408081 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.415434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b9bc95a5-d1f5-4b81-b3ca-a4ac0fd5740c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.141799 May 11 06:39:56.415992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 65/142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:56 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:56.470339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:56.470946 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:56.476887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:56.477331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:56.478097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:56.478531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:56.605314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:56.612424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-65b13dfd-e5cd-456a-a2f6-acafc4450b9b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.145913 May 11 06:39:56.612977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 78/143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:56 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:57.082054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:57.082655 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:57.088454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.088897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.089645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.090066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.092673 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:57.093275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:57.099016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.099520 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.100306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.100742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.304568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.307431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.310799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0f2aa05b-d1f2-4272-a79e-9d378421b296 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.232563 May 11 06:39:57.311676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 66/144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:57 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:57.315786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.317586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.318917 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-77c6b3b0-ea5d-4c27-b670-a6f10e50d915 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.230294 May 11 06:39:57.330681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 79/145] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:57 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:57.438800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:57.439445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:57.445232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.445801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.446580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.447018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.632625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:57.634225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:57.648087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.650083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.651237 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:57.653842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:57.722274 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.744663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa05d4ae-b545-4a33-a0aa-38fcdf7391a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.309616 May 11 06:39:57.754304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 67/146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:57 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:57.842505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:57.849707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0d09f315-d49c-4dfc-bc9a-ea70d63bc39b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.223711 May 11 06:39:57.850277 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 80/147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:57 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:58.329446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:58.330060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:58.335948 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.336397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.337156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.337592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.338221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:58.338914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:58.345595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.346128 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.346991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.347521 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.661229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:58.669290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a7ab1c48-4cef-4bc4-8034-a820c3d0ef4d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.343508 May 11 06:39:58.673198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 68/148] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:58 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:58.708391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:58.717277 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:58.719805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:58.721161 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-aaa4ee80-e8ad-4cdf-a9cd-4b69f9ac95e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.387795 May 11 06:39:58.721951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 81/149] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:58 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:39:58.762473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:58.764355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:58.778896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.780749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.782270 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.785012 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.868155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:58.868869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:58.878191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.879629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:58.881545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:58.883688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:59.090703 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.102680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a7864a40-c3f2-4752-b1c8-8f39b59c6be3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.344731 May 11 06:39:59.103801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 69/150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:58 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:59.151420 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.160737 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e0cffbe3-eb8a-428e-be28-6e7500f396a5 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.298645 May 11 06:39:59.171163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 82/151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:58 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:39:59.685851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:59.686539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:59.692572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:59.693019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:59.693808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:59.694243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:59.740208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:39:59.740811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:39:59.746618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:59.747312 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:59.747847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:39:59.748275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:39:59.875954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.884509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a3fa92f4-b1fe-49e0-a504-6a1f9c65b28b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.202494 May 11 06:39:59.885584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 70/152] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:39:59 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:39:59.920421 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.928619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.930220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:39:59.931409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d98e393d-1332-48ce-9a24-541d90b92bec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.195506 May 11 06:39:59.932059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 83/153] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:39:59 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:00.119872 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:00.120522 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:00.126804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.127253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.128211 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.128652 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.177994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:00.179059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:00.188085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.189185 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.191556 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.193509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.301033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:00.308411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-66c37e1c-5755-4080-bc75-3af9c21388ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.192259 May 11 06:40:00.308983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 71/154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:00 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:00.346384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:00.353518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cf62e2bd-a925-4768-aa66-60d558d649df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.179500 May 11 06:40:00.354182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 84/155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:00 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:00.902071 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:00.903374 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:00.910275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.910605 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.911709 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.912616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.952637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:00.953247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:00.960694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.961138 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:00.962093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:00.962715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:01.089108 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.099783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a72deb9c-4ce7-465a-8bff-fa32dafb9fd8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.201669 May 11 06:40:01.100834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 72/156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:00 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:01.308488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.316366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.317866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.318957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cc9364d8-a081-4430-8931-78be429a0b1f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.370122 May 11 06:40:01.319738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 85/157] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:00 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:01.330687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:01.330687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:01.336196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:01.336799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:01.337684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:01.338222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:01.370200 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:01.370799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:01.377373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:01.378010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:01.378934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:01.379547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:01.556413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.565946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-526916f1-0c72-489f-999c-2ca0d3276308 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.244056 May 11 06:40:01.567802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:01.572017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 73/158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:01 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:01.580221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f10ca69f-23da-47c0-ac32-66439c1751c6 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.213630 May 11 06:40:01.593764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 86/159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:01 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:02.011222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-48de18f8-e62c-4afb-9c4a-b737527175ea req-e0e88bea-d011-4f17-81ec-e903d9e35a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915", "name": "network-vif-plugged", "status": "completed", "tag": "f96eb40a-ee8f-4854-a24e-26c491a5b3ea"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:02.024524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-48de18f8-e62c-4afb-9c4a-b737527175ea req-e0e88bea-d011-4f17-81ec-e903d9e35a06 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.027107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-48de18f8-e62c-4afb-9c4a-b737527175ea req-e0e88bea-d011-4f17-81ec-e903d9e35a06 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.040552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-48de18f8-e62c-4afb-9c4a-b737527175ea req-e0e88bea-d011-4f17-81ec-e903d9e35a06 service nova] Creating event network-vif-plugged:f96eb40a-ee8f-4854-a24e-26c491a5b3ea for instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 on hv-cinder-80475 May 11 06:40:02.047224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-48de18f8-e62c-4afb-9c4a-b737527175ea req-e0e88bea-d011-4f17-81ec-e903d9e35a06 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039636 May 11 06:40:02.047961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 74/160] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:02.117684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:02.118793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:02.129869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.131607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.132560 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.135098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.282267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.289738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d39410dd-48fe-4b12-b75d-b75b74090ae3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.176369 May 11 06:40:02.290313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 87/161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:02 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:02.338786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:02.339606 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:02.346657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.347103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.347930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.348368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.494527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.502604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.504222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.505337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a1046d7f-080b-4382-a1fc-d88ba2ad468e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.170868 May 11 06:40:02.505898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 75/162] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:02 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:02.588277 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:02.589271 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:02.596597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.597292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.598249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.598858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.603659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:02.604370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:02.611577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.612617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.613489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:02.614127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:02.826680 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.845617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-309467dc-faa0-4a89-a4fa-be40c820292f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.260628 May 11 06:40:02.847572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 88/163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:02 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:02.860193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:02.868207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-158cb812-b24d-4c16-8cc2-c67bcebc4967 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.270391 May 11 06:40:02.878523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 76/164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:02 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:03.306882 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:03.307632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:03.314639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.315093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.315889 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.316338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.484781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:03.493791 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-665289ec-7f24-4eff-8f31-cda8bc767356 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.190586 May 11 06:40:03.494895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 89/165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:03 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:03.524237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:03.526107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:03.532489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.533180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.534175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.534794 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.675986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:03.684365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:03.686044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:03.687353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e65c1611-a2bc-4489-8d04-732a0a61a2c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.167057 May 11 06:40:03.687973 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 77/166] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:03 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:03.864144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:03.864858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:03.871219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.871826 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.872816 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.873577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.898015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:03.898015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:03.906776 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.907224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:03.908012 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:03.908448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:04.155965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.170994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3eb9cbd3-2971-4599-a81b-c9bac3039993 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.311535 May 11 06:40:04.174325 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.181667 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2de60921-c417-4406-8f76-b86b070a1c0b tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.300027 May 11 06:40:04.191492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 90/167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:03 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:04.191594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 78/168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:03 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:04.511982 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:04.513152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:04.519163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:04.519650 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:04.524410 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:04.525318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:04.661201 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.670206 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-063b3382-97cb-4f5a-b0af-163db2d6c8b1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.161952 May 11 06:40:04.670904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 91/169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:04 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:04.707088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:04.707716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:04.713471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:04.713912 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:04.714664 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:04.715126 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:04.842467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.850337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.851946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:04.853105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3dac04ce-4e9c-4662-a9f3-702a1da169fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.150341 May 11 06:40:04.853732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 79/170] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:04 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:05.197998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:05.198635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:05.204463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.204913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.205671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.206103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.208989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:05.209590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:05.216595 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.217198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.218123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.218715 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.507872 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:05.516446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e294514d-2704-4e70-9805-300df08882a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.311330 May 11 06:40:05.522265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 80/171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:05 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:05.533722 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:05.541647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ec74e5cc-3588-44f5-9e47-50242d05ab19 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.347703 May 11 06:40:05.551176 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 92/172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:05 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:05.687334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:05.688259 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:05.696800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.697543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.700393 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.701105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.866486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:05.873341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:05.874191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:05.874895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-634c8f60-7a71-4b06-87d7-69d4b54e0ef2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.192016 May 11 06:40:05.875503 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 81/173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:05 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:05.882949 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.883655 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:05.884649 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:05.885220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.032430 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:06.041086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:06.042651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:06.043974 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-44a0a22f-47ad-4c43-8d5a-81e8a44898c8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.175755 May 11 06:40:06.044689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 93/174] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:05 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:06.238940 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-ee9d052e-8a65-4ac8-8b66-5e8c54785d82 req-0f2a93d2-0e9f-4182-a8d2-636b7b2af29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c818b-6fff-427f-bab8-3f96e99bb236", "name": "network-vif-plugged", "status": "completed", "tag": "23e63531-0e9d-493d-ac18-7001469a18bd"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:06.249116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ee9d052e-8a65-4ac8-8b66-5e8c54785d82 req-0f2a93d2-0e9f-4182-a8d2-636b7b2af29c service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.249877 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ee9d052e-8a65-4ac8-8b66-5e8c54785d82 req-0f2a93d2-0e9f-4182-a8d2-636b7b2af29c service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.263316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-ee9d052e-8a65-4ac8-8b66-5e8c54785d82 req-0f2a93d2-0e9f-4182-a8d2-636b7b2af29c service nova] Creating event network-vif-plugged:23e63531-0e9d-493d-ac18-7001469a18bd for instance ce8c818b-6fff-427f-bab8-3f96e99bb236 on hv-cinder-80475 May 11 06:40:06.270366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-ee9d052e-8a65-4ac8-8b66-5e8c54785d82 req-0f2a93d2-0e9f-4182-a8d2-636b7b2af29c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035941 May 11 06:40:06.271314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 82/175] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:06.539724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:06.540351 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:06.548697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.549317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.550083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.550598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.569727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:06.570479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:06.576926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.577449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.578277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.578780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.752413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:06.759906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9be88fe2-f96a-4f07-a478-e46091d2e9c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.224384 May 11 06:40:06.769355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:06.769471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 94/176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:06 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:06.771171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-87cd024c-1cb0-4ae3-8a5c-2cf677732867 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.210474 May 11 06:40:06.771760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 83/177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:06 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:06.890934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:06.891577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:06.897403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.897897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:06.898643 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:06.899074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.022999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.030875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b4ce8ed1-08d0-4c1b-a3d1-e1a13b08fd49 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.143776 May 11 06:40:07.031460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 95/178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:06 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:07.061839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:07.062433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:07.068173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.068634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.069371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.069803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.191856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.199719 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.201717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.202806 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-def39f72-6c5f-404d-b454-26cd069df791 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.144787 May 11 06:40:07.203634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 84/179] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:07 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:07.777860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:07.779048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:07.788562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:07.789102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:07.791569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.792093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.792894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.793520 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.795055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.795645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.796323 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:07.796804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:07.989168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.995745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:07.997536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ce714323-37d1-41ae-98f7-89676cf5e533 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.223439 May 11 06:40:07.998498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 96/180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:07 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:08.003545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7ddc685e-3a6e-4f2f-a6b9-14ac5531c779 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.218859 May 11 06:40:08.004106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 85/181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:07 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:08.048032 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:08.048927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:08.055226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:08.055773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:08.056613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:08.057043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:08.190320 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:08.197434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fa6d13b8-1efb-4529-93d9-c71074ba772f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.153860 May 11 06:40:08.198253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 97/182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:08 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:08.220349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:08.220958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:08.226698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:08.227150 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:08.227954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:08.228395 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:08.356774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:08.364615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:08.366102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:08.367198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6956674d-6660-402a-b8bb-9b9afb786dd4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.150735 May 11 06:40:08.367797 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 86/183] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:08 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:09.014910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:09.015540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:09.020334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:09.020939 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:09.021462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.021904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.022659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.023089 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.026570 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.027016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.027833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.028245 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.219094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.221648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.227309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-13a698aa-53b6-4c81-85a7-4d05dbc9c15f tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.210677 May 11 06:40:09.229333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cb5bbc96-5291-402a-8956-707b5ec208d9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.218761 May 11 06:40:09.229902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 98/184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:09 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:09.234819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:09.235556 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:09.238187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 87/185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:09 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:09.241462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.241912 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.242679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.243112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.377512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.384501 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:09.385106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:09.385245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4d353ec2-e80f-49f4-b793-357782ef5efa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.154374 May 11 06:40:09.385804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 99/186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:09 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:09.392319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.392866 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.393721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:09.398074 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:09.534739 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.544264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.545904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:09.547135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6ffa7920-ca17-4ec5-934e-22ed1a365bdf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.166451 May 11 06:40:09.547880 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 88/187] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:09 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:10.245260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:10.246185 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:10.253276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:10.253893 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:10.256207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.256663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.257437 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.257885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.260539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.261020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.262003 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.262937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.453527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.457132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.461641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-249bb93a-6e6b-4f20-ac50-2a8f8d97f5e0 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.220404 May 11 06:40:10.462207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 100/188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:10 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:10.465857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5cc5dcf0-6d7e-41ae-bab6-9b0d85650598 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.216309 May 11 06:40:10.466530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 89/189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:10 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:10.467121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:10.467968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:10.473735 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.474178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.474931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.475375 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.566008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:10.566808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:10.574485 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.575827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.577077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:10.577839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:10.648413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.656182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-16703101-4a98-4da9-ba7d-6f0bf88c4d8b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.192825 May 11 06:40:10.656756 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 101/190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:10 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:10.755038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.763218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.764756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:10.765885 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bf0bf0f8-3dfb-4297-a88b-09cbfaa2381d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.203793 May 11 06:40:10.766442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 90/191] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:10 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:11.482733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:11.483449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:11.486525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:11.487761 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:11.489676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.490126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.491292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.491525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.494301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.494750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.495990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.684576 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.704084 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fa1aad14-4385-4bdd-b25a-fb52fbb32b1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.225969 May 11 06:40:11.704939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 102/192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:11 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:11.707127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.714523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-abd327fc-4fd6-4d3d-bbe1-11c115dc500a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1315 microversion: 2.1 time: 0.232177 May 11 06:40:11.714888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:11.715244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 91/193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:11 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:11.716386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:11.722347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.722847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.723885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.724453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.785689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:11.786350 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:11.792408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.792963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.794010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:11.794714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:11.887030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.910395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-40975870-cdb9-4665-98b4-8b7d68bce220 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.204244 May 11 06:40:11.919931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 103/194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:11 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:11.950315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.958465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.959990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:11.961083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62bad8f6-0d0f-42fb-886f-a5fc88f42d59 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.180374 May 11 06:40:11.961635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 92/195] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:11 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:12.723154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:12.723154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:12.731747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:12.732354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:12.739130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.739601 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.742832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.742832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.743098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.743098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.743914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.744296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.950037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:12.959489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1989d46c-faff-4782-b582-e3479801e56a tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1501 microversion: 2.1 time: 0.232063 May 11 06:40:12.960000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 93/196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:12 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:12.966844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:12.972103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:12.979772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:12.980335 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.980786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.982287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:12.982716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:12.989704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7d67426e-8409-4ac3-8bcf-f8db259dd25d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.272235 May 11 06:40:12.990572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 104/197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:12 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:13.003366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:13.004028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:13.010076 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:13.010673 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:13.011471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:13.011897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:13.233680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:13.245531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5f80a8b0-7ba1-4858-afc7-d3744901e36b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.283433 May 11 06:40:13.246587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 94/198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:12 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:13.260636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:13.269424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:13.270927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:13.272699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bb11e846-062e-4591-abf0-2fe9fb644e47 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.272917 May 11 06:40:13.273258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 105/199] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:12 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:14.005936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:14.006469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:14.012178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.012619 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.013377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.013810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.181330 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:14.190578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b1d48e86-56de-45a2-b971-2dbc47a4bc4e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.188025 May 11 06:40:14.191622 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 95/200] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:14 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:14.261732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:14.262386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:14.268426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.269167 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.270173 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.270817 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.296964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:14.297803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:14.308578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.309168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.310407 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.311006 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.563621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:14.569617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:14.571650 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-834a481c-5931-4903-a926-aad763f93764 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.313571 May 11 06:40:14.572357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 106/201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:14 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:14.581496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93faa5db-28f8-460a-86c2-140d989d2d2a"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:14.583048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:14.583483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:14.584811 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:14.586432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1e33936f-d852-41be-b02b-e219d422c652 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.298042 May 11 06:40:14.587054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 96/202] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:14 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:14.603393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.603393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.610990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-c4246976-0e39-47ea-923a-b967969135aa req-3ad34657-edd2-484c-918e-50a2d1918ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "name": "network-vif-plugged", "status": "completed", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:14.616568 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.617252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.625630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c4246976-0e39-47ea-923a-b967969135aa req-3ad34657-edd2-484c-918e-50a2d1918ca2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:14.629351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c4246976-0e39-47ea-923a-b967969135aa req-3ad34657-edd2-484c-918e-50a2d1918ca2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:14.679146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-c4246976-0e39-47ea-923a-b967969135aa req-3ad34657-edd2-484c-918e-50a2d1918ca2 service nova] Creating event network-vif-plugged:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:40:14.701965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-c4246976-0e39-47ea-923a-b967969135aa req-3ad34657-edd2-484c-918e-50a2d1918ca2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107797 May 11 06:40:14.702582 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 97/203] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:40:15.208077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:15.208799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:15.215472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.215940 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.216892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.217400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.363617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:15.370991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9a8c8510-6fae-47e6-9d78-96caf347daf7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.167073 May 11 06:40:15.372212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 98/204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:15 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:15.590429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:15.591073 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:15.596962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.597643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.598409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.598984 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.745880 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:15.755085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-de1a14f6-8298-45cd-a0e5-514bcf763793 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.167506 May 11 06:40:15.755828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 99/205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:15 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:15.760460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:15.761054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:15.766998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.767477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.768441 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:15.768872 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:15.906530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:15.914824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:15.916348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:15.917445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d3da9a83-7283-4f99-88bd-41d0465b4771 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.160724 May 11 06:40:15.918017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 100/206] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:15 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:16.364260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e4feb8db-f99c-4f73-b525-cf3153d271ec tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "POST /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.789002 May 11 06:40:16.366090 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 107/207] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:40:14 2022] POST /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341/os-volume_attachments => generated 194 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:16.389753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:16.390949 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:16.415482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.416427 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.421662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.424133 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.722460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:16.734617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-28b2eb4c-30ff-4721-9090-df7014cde7d3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.349839 May 11 06:40:16.735499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 101/208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:16 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:16.743321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-6a211f94-3c57-4690-9b8f-590c5bfb877d req-bf182a14-af46-4e22-8501-ccbf9c4a0d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe36d742-5157-4f04-9f55-02dfafa7d39a", "name": "network-vif-plugged", "status": "completed", "tag": "c372b82a-d12b-49fe-954d-646c72f56cf5"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:16.752094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-6a211f94-3c57-4690-9b8f-590c5bfb877d req-bf182a14-af46-4e22-8501-ccbf9c4a0d3d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.760228 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-6a211f94-3c57-4690-9b8f-590c5bfb877d req-bf182a14-af46-4e22-8501-ccbf9c4a0d3d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.773697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:16.774551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:16.781689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.786723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.787829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.788478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.795452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-6a211f94-3c57-4690-9b8f-590c5bfb877d req-bf182a14-af46-4e22-8501-ccbf9c4a0d3d service nova] Creating event network-vif-plugged:c372b82a-d12b-49fe-954d-646c72f56cf5 for instance fe36d742-5157-4f04-9f55-02dfafa7d39a on hv-cinder-80475 May 11 06:40:16.807194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-6a211f94-3c57-4690-9b8f-590c5bfb877d req-bf182a14-af46-4e22-8501-ccbf9c4a0d3d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066301 May 11 06:40:16.808231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 108/209] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:16.937669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:16.938896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:16.957891 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.958340 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:16.959112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:16.959577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:17.191418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:17.201750 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:17.203414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-55aa16a0-9734-4dda-945f-690bab146b12 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.435472 May 11 06:40:17.208796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 102/210] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:16 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:17.211204 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:17.213179 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:17.214411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e25be704-2c43-4141-ae03-8e248fc8bbaa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.282142 May 11 06:40:17.215182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 109/211] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:16 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:17.755536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:17.757338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:17.763726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:17.764516 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:17.765925 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:17.766648 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:17.994755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:18.007310 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bea85f49-15c3-4af1-b0dd-01d62a7dad33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1321 microversion: 2.1 time: 0.258732 May 11 06:40:18.017735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 103/212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:17 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:18.223758 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:18.224782 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:18.234408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:18.235023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:18.241538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:18.245746 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:18.246268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:18.247288 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:18.247775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:18.252529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:18.253944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:18.254527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:18.545762 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:18.557736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ee650bea-8ac4-46c7-ab71-a5e3ae5854ed tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.338168 May 11 06:40:18.558466 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 110/213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:18 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:18.563164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:18.573629 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:18.576373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:18.578093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-54991f88-effb-4380-bfeb-a72eacb8fd39 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.349259 May 11 06:40:18.579040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 104/214] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:18 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:40:19.027092 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:19.028053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:19.035171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.036122 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.037202 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.037881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.203009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.211019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b5b9a943-9f19-4fff-a6e1-f308d1d09f08 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1515 microversion: 2.1 time: 0.189429 May 11 06:40:19.211646 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 111/215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:19 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:19.228525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:19.229704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:19.236405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.236863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.237674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.238112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.304400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'flavor' on Instance uuid ce8c818b-6fff-427f-bab8-3f96e99bb236 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:40:19.439124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cf607b62-810c-4c0b-9027-1457b1558c0f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236/action" status: 200 len: 32 microversion: 2.1 time: 0.214877 May 11 06:40:19.439776 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 105/216] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:40:19 2022] POST /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:40:19.449071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:19.449875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:19.455951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.456633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.457455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.457999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.592345 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:19.594596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:19.604887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.605565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.607338 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.608043 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.610897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.618607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1bccb558-dade-460e-bc3a-a268bff90a50 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.173509 May 11 06:40:19.619436 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 112/217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:19 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:19.624280 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:19.625033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:19.631558 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.632184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.633164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:19.633737 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:19.817207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.827126 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c9510445-356b-4aaa-a562-891a9c11204e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.241983 May 11 06:40:19.827886 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 106/218] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:19 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:19.855625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.864178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.865681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:19.867933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d866f5cf-e59b-4f6a-94e6-d7b92bd9c0bf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1407 microversion: 2.20 time: 0.247330 May 11 06:40:19.868789 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 113/219] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:19 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:20.635913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:20.636521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:20.643008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.643578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:20.644369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.645029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:20.794918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:20.813432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0651c52-43f2-4c83-86a7-4a189a18ae55 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.181693 May 11 06:40:20.814021 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 107/220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:20 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:20.844909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:20.845597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:20.852531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.852980 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:20.854030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.854470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:20.887681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:20.888469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:20.895384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.896003 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:20.896915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:20.898055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:21.053768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:21.066952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e21347fc-a5fd-4808-9b13-51ccf2820df9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.226233 May 11 06:40:21.067777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 114/221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:20 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:21.088015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:21.098163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:21.100711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:21.102575 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c085e4a1-2976-4d1a-a8f4-5cf2567ea6bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1599 microversion: 2.20 time: 0.218919 May 11 06:40:21.103143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 108/222] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:40:20 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:40:21.123047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:21.123636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:21.129859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:21.130308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:21.131073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:21.131538 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:21.254143 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a81c376e-4269-4c60-a028-a4742be14fa5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135403 May 11 06:40:21.255773 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 115/223] 10.222.0.64 () {60 vars in 1315 bytes} [Wed May 11 06:40:21 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:40:21.834291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:21.835052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:21.848172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:21.848635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:21.849421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:21.849833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:22.091522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:22.091522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:22.092619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:22.093062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:22.094003 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:22.094453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:22.527406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:22.536915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-79d32ce2-89df-4e07-a3e0-48b3e1baaf48 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.709585 May 11 06:40:22.537715 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 109/224] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:21 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:22.655837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:22.669925 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8d56cc64-3946-4a25-9c44-aa5409ade76f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1366 microversion: 2.1 time: 0.588754 May 11 06:40:22.670550 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 116/225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:22 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:23.234852 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-a7f9fe0c-e47e-4be9-891a-a97a0d8322f7 req-3991c602-114b-4a7c-8b39-0fcb5e346e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:23.242898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a7f9fe0c-e47e-4be9-891a-a97a0d8322f7 req-3991c602-114b-4a7c-8b39-0fcb5e346e3f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.243377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a7f9fe0c-e47e-4be9-891a-a97a0d8322f7 req-3991c602-114b-4a7c-8b39-0fcb5e346e3f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.265777 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-a7f9fe0c-e47e-4be9-891a-a97a0d8322f7 req-3991c602-114b-4a7c-8b39-0fcb5e346e3f service nova] Creating event network-changed:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:40:23.284787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-a7f9fe0c-e47e-4be9-891a-a97a0d8322f7 req-3991c602-114b-4a7c-8b39-0fcb5e346e3f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042108 May 11 06:40:23.284787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 110/226] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:23.554337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:23.555674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:23.563449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.564038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.565058 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.565557 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.686956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:23.687708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:23.701082 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.702446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.705699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.706265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.745275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:23.753910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4796bfc0-db76-4a27-bfd1-c21fa810e8c0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.203395 May 11 06:40:23.759316 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 117/227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:23 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:23.864794 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:23.873125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a1c1691d-9fb8-4fba-8889-9df0666b90d0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1557 microversion: 2.1 time: 0.190915 May 11 06:40:23.873668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 111/228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:23 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:23.891150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:23.891702 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:23.897909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.898368 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:23.899146 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:23.900144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:24.002267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c34561e4-0db6-4015-acc6-4f6bf5f2004c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115043 May 11 06:40:24.002963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 118/229] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:40:23 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:40:24.771826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:24.772497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:24.780620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:24.781066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:24.787681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:24.788136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:25.217911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:25.228601 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d0c8c2db-0684-4dfd-ba76-bd0749344b77 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.460695 May 11 06:40:25.229369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 112/230] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:24 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:25.735832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-0427bb52-1e25-4cac-b55e-01b41489ccf2 req-d71a7907-9d2a-470d-99fd-8d8df2bcea16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe36d742-5157-4f04-9f55-02dfafa7d39a", "tag": "c372b82a-d12b-49fe-954d-646c72f56cf5"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:25.749683 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0427bb52-1e25-4cac-b55e-01b41489ccf2 req-d71a7907-9d2a-470d-99fd-8d8df2bcea16 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:25.750431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0427bb52-1e25-4cac-b55e-01b41489ccf2 req-d71a7907-9d2a-470d-99fd-8d8df2bcea16 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:25.765649 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-0427bb52-1e25-4cac-b55e-01b41489ccf2 req-d71a7907-9d2a-470d-99fd-8d8df2bcea16 service nova] Creating event network-changed:c372b82a-d12b-49fe-954d-646c72f56cf5 for instance fe36d742-5157-4f04-9f55-02dfafa7d39a on hv-cinder-80475 May 11 06:40:25.772240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-0427bb52-1e25-4cac-b55e-01b41489ccf2 req-d71a7907-9d2a-470d-99fd-8d8df2bcea16 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042767 May 11 06:40:25.773086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 119/231] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:26.247987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:26.249321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:26.258010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:26.258456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:26.259533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:26.260161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:26.493741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:26.507187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d23f8c2b-8cdc-475f-b642-a9c6cfad253f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.264940 May 11 06:40:26.509458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 113/232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:26 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:27.525932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:27.526681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:27.532952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:27.533450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:27.534246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:27.534763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:27.698539 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:27.706934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-039f3ef5-7e70-42af-aaaa-e5c6a0f6fa56 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.185663 May 11 06:40:27.707789 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 120/233] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:27 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:28.724288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:28.724896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:28.731102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:28.731620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:28.732384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:28.732879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:28.866188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:28.874096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0edff8f2-ea30-40f4-a484-977bd099c182 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.153700 May 11 06:40:28.874668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 114/234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:28 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:29.891641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:29.892240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:29.898659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:29.899102 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:29.899888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:29.900335 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:30.038267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:30.046007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-08b620f4-941b-4ad9-8151-bf657eccab21 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.159095 May 11 06:40:30.046585 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 121/235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:29 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:31.063693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:31.065125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:31.072270 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:31.073206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:31.075213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:31.075835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:31.448759 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:31.456715 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0430b308-ac5d-4265-a2fe-b241759891d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.397046 May 11 06:40:31.457496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 115/236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:31 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:32.473798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:32.474529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:32.481421 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.481871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:32.482633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.483066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:32.641553 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:32.652922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7b684c51-3a9d-441c-ad31-0abe9e0ba725 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.182591 May 11 06:40:32.653696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 122/237] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:32 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:32.764895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:32.765478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:32.772667 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.774824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:32.775634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.776061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:32.801005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:40:32.901852 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1f23c5e7-af66-4917-b07a-3cdc0722dad3 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 204 len: 0 microversion: 2.1 time: 0.141316 May 11 06:40:32.902459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 116/238] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:40:32 2022] DELETE /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:40:32.910846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:32.912244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:32.924769 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.925567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:32.926532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:32.927188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:33.054271 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:33.062431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3298a725-c02e-4b48-947b-4f58ba6da2df tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.155505 May 11 06:40:33.062996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 123/239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:32 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:33.670640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:33.671162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:33.676843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:33.677287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:33.678038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:33.678462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:33.809754 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:33.825211 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-74fabb4e-ca4d-4ab2-afde-86f20e2651b7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.159355 May 11 06:40:33.825795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 117/240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:33 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:34.078901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:34.079525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:34.085706 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:34.086143 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:34.086894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:34.087351 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:34.216295 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:34.224026 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e7bb5a1a-78df-4610-bf60-17c4cb8dadaa tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.148884 May 11 06:40:34.224601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 124/241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:34 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:34.844600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:34.845200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:34.851297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:34.851738 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:34.852494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:34.852918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:34.977618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:34.986037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3a457475-2691-48cc-bc02-740b82549c69 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.145165 May 11 06:40:34.986689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 118/242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:34 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:35.240587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:35.241127 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:35.247536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:35.247985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:35.248744 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:35.249203 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:35.380413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:35.388165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0f7dc3b6-4602-4ce2-aa49-fbb56c35b236 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.151440 May 11 06:40:35.388726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 125/243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:35 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:36.003028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:36.003663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:36.009770 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:36.010217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:36.010983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:36.011458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:36.145562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:36.152980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-89ead590-c6cc-4411-8939-e5b5ed56374b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.153790 May 11 06:40:36.153541 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 119/244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:35 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:36.405258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:36.405862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:36.412195 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:36.412649 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:36.413425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:36.413861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:36.544727 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:36.554852 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e086a6e5-27a0-40eb-ba61-f53af53cdb2d tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.153472 May 11 06:40:36.555861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 126/245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:36 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:37.169270 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:37.169987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:37.176909 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:37.177354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:37.178121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:37.178544 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:37.309744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:37.317038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3e16a449-b7b8-4d08-a82e-047c6f4425bf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.152136 May 11 06:40:37.317678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 120/246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:37 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:37.571977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:37.572575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:37.579455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:37.579906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:37.580674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:37.581106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:37.953984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:37.961836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-26434ef3-d1f4-43cd-8184-6be2f08c2283 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.393707 May 11 06:40:37.962408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 127/247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:37 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:38.333756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:38.334367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:38.340533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:38.340963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:38.341720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:38.342327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:38.486276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:38.493808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6e9a96a4-e646-4552-828e-1cc46d675dcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.163788 May 11 06:40:38.494377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 121/248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:38 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:38.979295 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:38.980273 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:38.986834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:38.987545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:38.988483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:38.989070 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:39.148885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:39.186370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3f8b1d5f-db24-428e-a579-b2bebb671e13 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1553 microversion: 2.1 time: 0.210841 May 11 06:40:39.193447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 128/249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:38 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:39.268915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-0903a68d-7c0e-4a0b-9e52-b5a0de7aa87b req-4ba2e108-a9ea-426f-9deb-628d6b0db6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6edb4e8f-f617-4c28-ac15-600d89a37341", "name": "network-vif-deleted", "tag": "8f2b511e-a9e7-4379-8934-794a6bb1007d"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:40:39.276927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0903a68d-7c0e-4a0b-9e52-b5a0de7aa87b req-4ba2e108-a9ea-426f-9deb-628d6b0db6e6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:39.277924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0903a68d-7c0e-4a0b-9e52-b5a0de7aa87b req-4ba2e108-a9ea-426f-9deb-628d6b0db6e6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:39.290418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-0903a68d-7c0e-4a0b-9e52-b5a0de7aa87b req-4ba2e108-a9ea-426f-9deb-628d6b0db6e6 service nova] Creating event network-vif-deleted:8f2b511e-a9e7-4379-8934-794a6bb1007d for instance 6edb4e8f-f617-4c28-ac15-600d89a37341 on hv-cinder-80475 May 11 06:40:39.295826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-0903a68d-7c0e-4a0b-9e52-b5a0de7aa87b req-4ba2e108-a9ea-426f-9deb-628d6b0db6e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030700 May 11 06:40:39.296711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 122/250] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:40:39.510929 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:39.512106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:39.518547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:39.518998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:39.519800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:39.520239 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:39.681263 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:39.689114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0ae444a9-c8e4-4cef-b4bc-617658165853 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.181934 May 11 06:40:39.689939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 129/251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:39 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:40.210722 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:40.211540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:40.218163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:40.218617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:40.219469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:40.219911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:40.250563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:40.251130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:40.251610 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lazy-loading 'fault' on Instance uuid 6edb4e8f-f617-4c28-ac15-600d89a37341 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:40:40.297341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da53e103c1e74a9b8907a7076b234171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08265213a8e840179ab9d62cf0bc86ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:40.310723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0f11515e-7731-43d7-ad61-900a1cbb6ec7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 200 len: 1351 microversion: 2.1 time: 0.104401 May 11 06:40:40.311648 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 123/252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:40 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:40.705881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:40.706486 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:40.712754 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:40.713196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:40.713956 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:40.714490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:40.900367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:40.908460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-25e4a501-caa4-469c-9707-2a7a5f191b3a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.206258 May 11 06:40:40.909783 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 130/253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:40 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:41.329264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:41.330030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:41.336802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.342613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:41.343506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.343962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:41.359303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] HTTP exception thrown: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Request method failure captured: May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 HTTP/1.1 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oKAF6pwdA8E6W-5gJoskjNlXXRTuza8o5ZPaJxCM6JMStgQg5Jygr1_LPNBaDKZ5PNnXfCLzR5fTIj9Tx7mSy7Z67DKoVolRJoSB7R-q0NTn3UfwjNp9Jyi0tbUiuPWvYfdwcl28KOrZc7RRfIwPtRRQ_yN4QvfGNc-_HO3gvTTN0 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:40:41.364106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: da53e103c1e74a9b8907a7076b234171 May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.365536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '6edb4e8f-f617-4c28-ac15-600d89a37341'} May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:40:41.366409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.367968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:41.369178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Returning 404 to user: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:40:41.369178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62ef29b2-968a-482c-bef4-ed81fad41925 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 404 len: 111 microversion: 2.1 time: 0.041248 May 11 06:40:41.369178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 124/254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:41 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:40:41.477545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:41.478528 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:41.485392 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.485837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:41.486605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.487036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:41.499254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] HTTP exception thrown: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Request method failure captured: May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341/os-volume_attachments HTTP/1.1 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oKAF6pwdA8E6W-5gJoskjNlXXRTuza8o5ZPaJxCM6JMStgQg5Jygr1_LPNBaDKZ5PNnXfCLzR5fTIj9Tx7mSy7Z67DKoVolRJoSB7R-q0NTn3UfwjNp9Jyi0tbUiuPWvYfdwcl28KOrZc7RRfIwPtRRQ_yN4QvfGNc-_HO3gvTTN0 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:40:41.503331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: da53e103c1e74a9b8907a7076b234171 May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.504768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'server_id': '6edb4e8f-f617-4c28-ac15-600d89a37341'} May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:40:41.505488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:41.506780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:41.508091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Returning 404 to user: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:40:41.508091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ae1aafb0-0c94-457c-81ac-a35a768d2688 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031202 May 11 06:40:41.508091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 131/255] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:40:41 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:40:41.925580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:41.926182 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:41.931998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.932442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:41.933198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:41.934173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:42.082524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:42.089845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a8c536ef-a239-40f9-891d-aa6773cdc7d0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.168025 May 11 06:40:42.090460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 125/256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:41 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:42.699532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:42.700288 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:42.707505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:42.708304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:42.709606 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:42.710803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:42.729447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] HTTP exception thrown: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Request method failure captured: May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 HTTP/1.1 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oKAF6pwdA8E6W-5gJoskjNlXXRTuza8o5ZPaJxCM6JMStgQg5Jygr1_LPNBaDKZ5PNnXfCLzR5fTIj9Tx7mSy7Z67DKoVolRJoSB7R-q0NTn3UfwjNp9Jyi0tbUiuPWvYfdwcl28KOrZc7RRfIwPtRRQ_yN4QvfGNc-_HO3gvTTN0 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:40:42.732564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: da53e103c1e74a9b8907a7076b234171 May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.734114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '6edb4e8f-f617-4c28-ac15-600d89a37341'} May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:40:42.734896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.736292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:40:42.737577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Returning 404 to user: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:40:42.737577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-15bcfdb9-4d0f-489e-b048-336bb92afb48 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 404 len: 111 microversion: 2.1 time: 0.041378 May 11 06:40:42.739021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 132/257] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:40:42 2022] DELETE /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:40:42.744051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:42.744740 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] [instance: 6edb4e8f-f617-4c28-ac15-600d89a37341] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:42.751910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:42.752598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:42.753551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:42.754243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:42.767832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] HTTP exception thrown: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Request method failure captured: May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 HTTP/1.1 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oKAF6pwdA8E6W-5gJoskjNlXXRTuza8o5ZPaJxCM6JMStgQg5Jygr1_LPNBaDKZ5PNnXfCLzR5fTIj9Tx7mSy7Z67DKoVolRJoSB7R-q0NTn3UfwjNp9Jyi0tbUiuPWvYfdwcl28KOrZc7RRfIwPtRRQ_yN4QvfGNc-_HO3gvTTN0 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:40:42.769458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/08265213a8e840179ab9d62cf0bc86ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 08265213a8e840179ab9d62cf0bc86ab May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-DeleteServersTestJSON-175934944 May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: da53e103c1e74a9b8907a7076b234171 May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-DeleteServersTestJSON-175934944-project May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.770795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '6edb4e8f-f617-4c28-ac15-600d89a37341'} May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:40:42.771525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. May 11 06:40:42.772584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:40:42.773540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] Returning 404 to user: Instance 6edb4e8f-f617-4c28-ac15-600d89a37341 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:40:42.773540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a980a799-05a6-48b1-b1e6-7c9db7d7a5c7 tempest-DeleteServersTestJSON-175934944 tempest-DeleteServersTestJSON-175934944-project] 10.222.0.64 "GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341" status: 404 len: 111 microversion: 2.1 time: 0.030798 May 11 06:40:42.773540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 126/258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:42 2022] GET /compute/v2.1/servers/6edb4e8f-f617-4c28-ac15-600d89a37341 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:40:43.105777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:43.106483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:43.112449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:43.112893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:43.113656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:43.114083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:43.248662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:43.256794 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1030dfb0-f7be-4a41-9430-21af00407646 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.154781 May 11 06:40:43.257374 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 133/259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:43 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:44.274267 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:44.275179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:44.282119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:44.282562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:44.283369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:44.283799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:44.420234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:44.427818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fec9112a-fa2b-44eb-a661-db7c58db1cf0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.157940 May 11 06:40:44.428387 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 127/260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:44 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:45.444729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:45.445363 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:45.451678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:45.452145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:45.452931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:45.453366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:45.582807 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:45.590455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-18d1fbd2-a87b-4f4c-b9ed-a7354f47e2c6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.149552 May 11 06:40:45.591017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 134/261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:45 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:46.606917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:46.607549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:46.613378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:46.613821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:46.614577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:46.615009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:46.740294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:46.747491 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-83c7deec-56b6-4be0-ae9a-b3b9eeeca94d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.144403 May 11 06:40:46.748051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 128/262] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:46 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:47.763723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:47.764275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:47.770555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:47.771006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:47.771798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:47.772230 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:47.904162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:47.911641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e6297e0a-b90b-41bf-af40-f6b12b89ec53 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.151787 May 11 06:40:47.912228 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 135/263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:47 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:47.975088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-161f5bae-4927-4896-b900-0697952819ab tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8dd2820>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:48.021316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-161f5bae-4927-4896-b900-0697952819ab tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ef1ded17-5a92-40fd-b68d-1c388141833b" status: 200 len: 350 microversion: 2.1 time: 0.049881 May 11 06:40:48.021897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 129/264] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:40:47 2022] GET /compute/v2.1/os-volumes/ef1ded17-5a92-40fd-b68d-1c388141833b => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:48.929647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:48.930254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:48.937194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:48.937640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:48.938419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:48.938846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:49.064850 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:49.072055 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6e57da5a-36c1-4e30-b276-30ef36d5f8fe tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.146283 May 11 06:40:49.072612 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 136/265] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:48 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:49.342259 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a7f750ae-367a-4fd0-b71c-43a564178627 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8dd2040>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:49.388400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a7f750ae-367a-4fd0-b71c-43a564178627 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b4d7700e-9f04-4329-80a1-333c0f1993d1" status: 200 len: 351 microversion: 2.1 time: 0.050482 May 11 06:40:49.388971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 130/266] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:40:49 2022] GET /compute/v2.1/os-volumes/b4d7700e-9f04-4329-80a1-333c0f1993d1 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:50.088861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:50.089399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:50.096062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:50.096505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:50.097439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:50.097896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:50.230253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:50.238152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f9020e5a-ebcf-4bc4-840e-5409d8c710f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.153203 May 11 06:40:50.238716 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 137/267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:50 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:50.704543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-47d876c9-b485-4780-a227-3b5540fb3dbd tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8dd24c0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:50.749779 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-47d876c9-b485-4780-a227-3b5540fb3dbd tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/9d25bf45-924f-4957-a67f-e6e3dc4e1933" status: 200 len: 351 microversion: 2.1 time: 0.049524 May 11 06:40:50.750346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 131/268] 10.222.0.64 () {58 vars in 1244 bytes} [Wed May 11 06:40:50 2022] GET /compute/v2.1/os-volumes/9d25bf45-924f-4957-a67f-e6e3dc4e1933 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:50.761084 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1e891fa8-420e-497f-af7e-5df8e361bc29 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c87230d0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:50.843353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1e891fa8-420e-497f-af7e-5df8e361bc29 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084927 May 11 06:40:50.844011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 138/269] 10.222.0.64 () {58 vars in 1133 bytes} [Wed May 11 06:40:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:50.858035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e7c96a85-a952-4c36-b683-24cd39678d1c tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5cb14ba60>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:50.937008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e7c96a85-a952-4c36-b683-24cd39678d1c tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083395 May 11 06:40:50.937656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 132/270] 10.222.0.64 () {58 vars in 1148 bytes} [Wed May 11 06:40:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:50.949457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-762a4552-4950-47f0-80a7-9ace6cf18b77 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8636820>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.032944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-762a4552-4950-47f0-80a7-9ace6cf18b77 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087350 May 11 06:40:51.033520 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 139/271] 10.222.0.64 () {58 vars in 1133 bytes} [Wed May 11 06:40:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:51.044923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-221c6273-4864-48f2-8dc4-484debe4a4df tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8dd2dc0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.124483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-221c6273-4864-48f2-8dc4-484debe4a4df tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083818 May 11 06:40:51.125069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 133/272] 10.222.0.64 () {58 vars in 1166 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:51.136826 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-04701a4b-f109-40b5-b5f6-a3ed2de152b5 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c86d6790>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.217555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-04701a4b-f109-40b5-b5f6-a3ed2de152b5 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084902 May 11 06:40:51.218215 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 140/273] 10.222.0.64 () {58 vars in 1169 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:40:51.229631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fd7f26c4-5a9c-4615-b888-026a91ccdd6e tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8de6280>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.255507 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.256118 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:51.267300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:51.267300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:51.267300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:51.267300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:51.325602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fd7f26c4-5a9c-4615-b888-026a91ccdd6e tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099068 May 11 06:40:51.326459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 134/274] 10.222.0.64 () {58 vars in 1154 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:51.337670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e75a6a42-2909-4d77-ae64-e38f42138137 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8dd2550>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.433618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e75a6a42-2909-4d77-ae64-e38f42138137 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099929 May 11 06:40:51.434430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 135/275] 10.222.0.64 () {58 vars in 1187 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:40:51.441915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:51.446090 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e3cfcc18-002f-45a9-bc23-da20924882a6 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] Calling method '.version_select at 0x7fc5c8fbc940>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:51.453074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a50457c6-0afb-4865-9003-5bd9bbfdd0a3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.201586 May 11 06:40:51.462618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 141/276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:51.536834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e3cfcc18-002f-45a9-bc23-da20924882a6 tempest-VolumesTestJSON-1456207752 tempest-VolumesTestJSON-1456207752-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094506 May 11 06:40:51.537549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 136/277] 10.222.0.64 () {58 vars in 1154 bytes} [Wed May 11 06:40:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:52.469877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:52.470479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:52.480314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:52.480769 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:52.482423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:52.483443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:52.625944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:52.635304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-caaefac8-2fd3-48c3-ba05-89d29bf6c74f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.168501 May 11 06:40:52.635627 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 142/278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:52 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:53.651243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:53.651991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:53.658748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:53.659204 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:53.660010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:53.660461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:53.791855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:53.799715 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-16988840-0be1-449a-aee3-1fb8ac7d0d7a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.152261 May 11 06:40:53.800617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 137/279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:53 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:54.816779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:54.817284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:54.824055 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:54.824498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:54.825944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:54.826372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:54.960391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:54.969086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8a491465-eabc-4596-bf76-4e57247db37b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.155918 May 11 06:40:54.978362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 143/280] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:54 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:55.986143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:55.986802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:55.992922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:55.993371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:55.994142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:55.994574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:56.142256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:56.149505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7cbfba50-4b2a-4b8c-9593-973802925c57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.167376 May 11 06:40:56.150253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 138/281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:55 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:57.166016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:57.166648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:57.173402 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:57.173849 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:57.175589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:57.176253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:57.311372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:57.318676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-24e10876-e27a-4489-906b-c00861fed4e4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.156497 May 11 06:40:57.328514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 144/282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:57 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:40:58.335105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:58.335791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:58.343039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:58.343884 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:58.344924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:58.345521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:58.504011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:58.520121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bcf47af3-e5a4-44eb-a6d7-b05b151ee936 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.188842 May 11 06:40:58.520776 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 139/283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:58 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:40:59.537584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:40:59.546964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:40:59.553584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:59.554036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:59.554820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:40:59.555408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:40:59.707504 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:40:59.716020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-10450948-de3b-4c16-b1c7-1ca6a4588ce9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.181908 May 11 06:40:59.716598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 145/284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:40:59 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:00.734321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:00.735028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:00.741487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:00.741944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:00.742723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:00.743164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:00.940373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:00.962308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c028a947-dfc8-4741-a46b-478da231076b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.225647 May 11 06:41:00.962308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 140/285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:00 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:01.971240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:01.971905 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:01.978382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:01.978835 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:01.979639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:01.980082 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:02.109713 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:02.116899 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ed01c5f6-9d12-457d-a61f-d72e5c58c8e3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.149425 May 11 06:41:02.117464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 146/286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:01 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:03.133219 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:03.133768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:03.140630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:03.141023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:03.141844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:03.142277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:03.270447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:03.277700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-59307c22-9f35-42c1-9373-20a890274519 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.148170 May 11 06:41:03.278266 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 141/287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:03 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:04.294359 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:04.294840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:04.301691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:04.302211 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:04.303085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:04.303609 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:04.446174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:04.454532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d94787b5-5e95-4a42-869e-de5416f1697a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.164587 May 11 06:41:04.455407 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 147/288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:04 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:05.472631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:05.473520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:05.480743 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:05.481273 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:05.482140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:05.482584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:05.624947 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:05.632298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-09b960bf-214b-4c02-bdc2-22bff6bde69e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.164832 May 11 06:41:05.632860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 142/289] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:05 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:06.650741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:06.651492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:06.658819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:06.659431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:06.660217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:06.660652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:06.791641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:06.799786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ce188095-28bb-4a3c-b2a0-15384f8d8d49 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.153857 May 11 06:41:06.800235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 148/290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:06 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:07.816828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:07.817425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:07.823414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:07.823857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:07.824600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:07.825028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:07.963985 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:07.971409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4e2a400b-ccd3-4e91-b8b6-638362eee313 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.158193 May 11 06:41:07.972015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 143/291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:07 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:08.988183 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:08.988793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:08.995091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:08.995581 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:08.996353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:08.996790 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:09.125982 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:09.133295 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-29a57897-0ca5-4bef-b9d4-b5504561a282 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.148990 May 11 06:41:09.133846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 149/292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:08 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:10.149929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:10.150566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:10.156571 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:10.157018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:10.157804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:10.158235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:10.284567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:10.291709 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1eaab05e-e55e-4fd0-9b64-10d1cfc6afc4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.145707 May 11 06:41:10.292275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 144/293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:10 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:11.308713 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:11.309318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:11.316278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:11.316727 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:11.317493 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:11.317924 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:11.597458 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:11.604739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7d44cfcc-8570-473c-9fb0-5df516e419e9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.299838 May 11 06:41:11.605330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 150/294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:11 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:12.622547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:12.623142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:12.628974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:12.629421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:12.630184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:12.630627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:12.763551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:12.770793 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9797c29c-93e0-4380-a7f6-f72f7e75a516 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.152206 May 11 06:41:12.771396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 145/295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:12 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:13.788314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:13.788868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:13.794994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:13.795971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:13.796732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:13.797164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:13.927536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:13.935017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-596beea8-754d-441d-b401-2820bf7cd35e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.150644 May 11 06:41:13.935591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 151/296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:13 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:14.954399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:14.955495 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:14.961702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:14.962437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:14.963361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:14.963978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:15.277407 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:15.285356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-61787221-e11c-42c8-bc76-5d3c2b490fa5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.336448 May 11 06:41:15.285969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 146/297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:14 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:16.302341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:16.303889 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:16.320351 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:16.321934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:16.323236 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:16.323862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:16.459150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:16.466380 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a3fa3ef2-3c0c-4957-b33c-3a3b48c25b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1521 microversion: 2.1 time: 0.168001 May 11 06:41:16.466993 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 152/298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:16 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:17.483088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:17.484003 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:17.490672 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:17.491370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:17.492297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:17.492887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:17.638140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:17.650566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d9d69fea-7465-4451-b12d-c5d0ee8a4c72 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1501 microversion: 2.1 time: 0.171401 May 11 06:41:17.651123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 147/299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:17 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:17.666318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:17.666935 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:17.673596 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:17.674042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:17.674814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:17.675245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:17.807024 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:17.814942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1d5013f0-e8ec-49f3-bd44-7cf41832f09f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1515 microversion: 2.1 time: 0.152489 May 11 06:41:17.815808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 153/300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:17 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:21.286239 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:21.287530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:21.294164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:21.294611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:21.295406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:21.295850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:21.319449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'flavor' on Instance uuid acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:21.396991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a8d8a179-df3e-445f-962e-6e6186787774 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/action" status: 200 len: 32 microversion: 2.1 time: 0.114651 May 11 06:41:21.397589 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 148/301] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:41:21 2022] POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:41:21.407133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:21.408294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:21.416468 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:21.416968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:21.417751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:21.418426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:21.574506 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:21.585093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-83281c16-293d-40eb-ab3a-c072cf2fbce7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.182174 May 11 06:41:21.586803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 154/302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:21 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:22.603623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:22.604324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:22.611396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:22.611696 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:22.612444 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:22.612876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:22.749675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:22.757536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b5cfa804-7221-412f-90af-600caa899a4f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.158237 May 11 06:41:22.758183 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 149/303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:22 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:23.774815 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:23.775462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:23.781733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:23.782194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:23.782934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:23.783396 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:23.911360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:23.918726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fa44bce2-4734-42da-837f-ee44967ed069 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.147736 May 11 06:41:23.919288 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 155/304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:23 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:24.936224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:24.937054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:24.943703 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:24.944150 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:24.944963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:24.945424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:25.070438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:25.078606 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-70c886ce-aaf8-4ea7-81a0-baa1d7ea41dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.146636 May 11 06:41:25.079165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 150/305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:24 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:26.095968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:26.096574 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:26.102850 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:26.103389 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:26.104153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:26.104589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:26.242019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:26.249933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-15133b6c-c4ed-4c5c-b368-b4b2d829c70e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.158558 May 11 06:41:26.250490 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 156/306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:26 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:27.268513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:27.269117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:27.274995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:27.275470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:27.276222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:27.276654 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:27.398494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:27.406348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d26a35c0-26ed-4dbd-9eb6-9c0bbdb179b9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.141668 May 11 06:41:27.406907 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 151/307] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:27 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:28.423014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:28.423652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:28.430012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:28.430464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:28.431676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:28.431676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:28.557827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:28.565697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-92a829aa-2032-4476-8de6-44339f670a32 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.146617 May 11 06:41:28.566285 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 157/308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:28 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:29.583174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:29.583810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:29.590009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:29.590594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:29.591431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:29.592440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:29.721582 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:29.728945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-12efd78a-6f8d-4c39-90c0-dfd875714d3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.149635 May 11 06:41:29.729532 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 152/309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:29 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:30.745634 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:30.746291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:30.752594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:30.753040 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:30.753801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:30.754235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:30.884612 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:30.891948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8bfea8dd-9f2a-4225-b88a-2e8e2fc50f8d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.150151 May 11 06:41:30.892512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 158/310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:30 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:31.796023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:31.797209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:31.806707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:31.807484 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:31.808712 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:31.809472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:31.849002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8838ffb0-df7d-43e6-b53f-3c1690b53f33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/ips" status: 200 len: 152 microversion: 2.20 time: 0.060095 May 11 06:41:31.849864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 153/311] 10.222.0.64 () {60 vars in 1288 bytes} [Wed May 11 06:41:31 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/ips => generated 152 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:41:31.909422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:31.910137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:31.918884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:31.919384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:31.921281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:31.921958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:32.125519 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:32.135193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-28d46ccb-e17a-4549-9266-f7cb7622e60d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.230547 May 11 06:41:32.135790 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 159/312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:31 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:33.152763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:33.153529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:33.160294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:33.160875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:33.161865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:33.162374 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:33.329395 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:33.335314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f82aef4f-7d81-4ea6-9259-005439506c1b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.183106 May 11 06:41:33.335314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 154/313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:33 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:34.351235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:34.351799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:34.358881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:34.359346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:34.360120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:34.360552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:34.479833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-38564799", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:34.488028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:34.495453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-12d5c783-0183-4f34-ab9f-4be2650ce21b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.148127 May 11 06:41:34.496098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 160/314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:34 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:34.528136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] validate_networks() for None {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:41:35.007543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:41:35.007992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:41:35.008506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:41:35.008914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:41:35.009356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:41:35.018361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:35.018924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:35.019868 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:35.020308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:35.036910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Getting quotas for project 566cec90becf440c860b261b3153e5d6. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:41:35.040975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Getting quotas for user 5e36b0835abc4beebe51d1a6f71ef9fc and project 566cec90becf440c860b261b3153e5d6. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:41:35.052333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:41:35.054559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:41:35.098469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3e69b33b-0b5a-4cae-9d0d-5e692e7d134b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623338 May 11 06:41:35.099296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 155/315] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:41:35.109224 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-aba080d6-1a9f-416a-bf50-afbf8c9bc086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:35.109966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-aba080d6-1a9f-416a-bf50-afbf8c9bc086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:35.164239 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aba080d6-1a9f-416a-bf50-afbf8c9bc086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:35.171389 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-aba080d6-1a9f-416a-bf50-afbf8c9bc086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1213 microversion: 2.1 time: 0.066289 May 11 06:41:35.172945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:35 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:35.512414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:35.513026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:35.519157 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:35.519645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:35.520409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:35.520845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:35.654745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:35.662002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e8647d14-b237-4b03-879f-27811728615b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.153542 May 11 06:41:35.662555 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 156/317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:35 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:36.189728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:36.190340 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:36.196701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:36.197144 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:36.198277 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:36.198584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:36.262569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:36.270996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ff27dcce-1f39-4c84-9caa-d57b889a90c1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1217 microversion: 2.1 time: 0.085025 May 11 06:41:36.271674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 162/318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:36 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:36.678459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:36.679062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:36.685037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:36.686173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:36.686928 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:36.687396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:36.813264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:36.820798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0fcf6742-fc9c-4c48-b9ec-097a20ba6013 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.146248 May 11 06:41:36.821365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 157/319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:36 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:37.288423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:37.289029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:37.296075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.296518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.297276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.297708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.364059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:37.371852 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fafa5d72-5b3f-4e29-926b-3e720071c141 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1217 microversion: 2.1 time: 0.087128 May 11 06:41:37.372419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 163/320] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:37 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:37.746744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:37.747348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:37.753608 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.754053 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.754810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.755243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.776925 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'flavor' on Instance uuid 86b8d3ad-c5ac-43be-9752-33e7891c2aec {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:37.838493 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:37.839096 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:37.845675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.846124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.846895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:37.847362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:37.993779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:38.003577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8aee7a62-3adf-45bb-b7ea-c093b59ed22a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.169415 May 11 06:41:38.004480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 164/321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:37 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:38.075767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6248f7e4-2d6f-4a49-a4bf-9a831783df4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/action" status: 202 len: 0 microversion: 2.20 time: 0.332602 May 11 06:41:38.077662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 158/322] 10.222.0.64 () {62 vars in 1318 bytes} [Wed May 11 06:41:37 2022] POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 06:41:38.092595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:38.093209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:38.103194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:38.103674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:38.104481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:38.104925 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:38.266680 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:38.274985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:38.276549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:38.278163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c8d409b8-f2fc-4373-ae3f-8302a52ca2ea tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.196242 May 11 06:41:38.278741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 165/323] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:38 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:38.389486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:38.390194 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:38.396540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:38.397220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:38.398237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:38.398827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:38.489271 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:38.497329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9d365c13-a891-4284-b5c7-eda73be730f4 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1283 microversion: 2.1 time: 0.112480 May 11 06:41:38.498596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 159/324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:38 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:39.020416 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:39.021022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:39.027382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.027833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.028668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.029290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.165122 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:39.173577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bc3b20b3-2a14-4753-a04d-49c328e19aab tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.157174 May 11 06:41:39.174140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 166/325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:39 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:39.302743 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:39.303373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:39.309054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.309509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.310263 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.310697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.518011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:39.518701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:39.525923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.526493 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.527504 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:39.528043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:39.531603 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:39.541336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:39.543347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:39.545153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4bb94b01-58e4-4d4b-98cb-b3abee4d8fa2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.246009 May 11 06:41:39.545717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 160/326] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:39 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:39.705362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:39.714671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0e110f2b-9704-4df4-ae33-1cb411f518fb tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.204245 May 11 06:41:39.715387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 167/327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:39 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:40.191014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:40.192012 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:40.199579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-c7c38203-4320-45e9-9f2f-43b59bdee3e4 req-71474d0c-f63b-4024-b861-ae668b340a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6e5702-6dc0-4ad4-83d4-e955f6017d38", "tag": "2a7723b1-e98a-4b60-b0dd-58e2ffc809bc"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:40.210149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.211036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-c7c38203-4320-45e9-9f2f-43b59bdee3e4 req-71474d0c-f63b-4024-b861-ae668b340a4c service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.211676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-c7c38203-4320-45e9-9f2f-43b59bdee3e4 req-71474d0c-f63b-4024-b861-ae668b340a4c service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.214118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.215040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.215506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.226405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-c7c38203-4320-45e9-9f2f-43b59bdee3e4 req-71474d0c-f63b-4024-b861-ae668b340a4c service nova] Creating event network-changed:2a7723b1-e98a-4b60-b0dd-58e2ffc809bc for instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 on hv-cinder-80475 May 11 06:41:40.234481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-c7c38203-4320-45e9-9f2f-43b59bdee3e4 req-71474d0c-f63b-4024-b861-ae668b340a4c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 May 11 06:41:40.236279 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 168/328] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:41:40.380377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:40.388190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e8dabddf-0685-42b3-986c-996b3f4ecf8a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.201148 May 11 06:41:40.398322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 161/329] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:40 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:40.565516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:40.566648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:40.573149 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.573762 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.574591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.575033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.720022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:40.727846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:40.729341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:40.730501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-04253cda-8981-4b8b-8857-70ffdaf8cb9c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.170322 May 11 06:41:40.731166 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 169/330] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:40 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:40.731328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:40.732635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:40.738815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.739258 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.740038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:40.740471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:40.864972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:40.872106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a0a20103-dfaa-46d6-b3ec-507e2d8601c0 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.144680 May 11 06:41:40.872718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 162/331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:40 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:41.405090 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:41.405705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:41.411982 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.412437 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.413208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.413646 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.542009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:41.549846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-449511d5-e1f5-4a83-bfdb-088ca7225513 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.148641 May 11 06:41:41.550405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 170/332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:41 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:41.749647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:41.750365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:41.756466 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.756917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.757682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.758112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.889814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:41.890691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:41.897867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.898544 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.899516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:41.900116 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:41.903038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:41.916845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:41.921064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:41.922407 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6a5fd5b6-b494-4b3b-a1f2-4c89890d18f4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.176594 May 11 06:41:41.939523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 163/333] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:41 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:42.051077 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:42.058463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-72bf3449-e2c3-42d9-92c4-189ff7052c99 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.173523 May 11 06:41:42.059152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 171/334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:41 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:42.567202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:42.567757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:42.575380 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:42.576381 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:42.577193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:42.577636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:42.721192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:42.728566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ae2803c6-18db-4355-a1ef-4ebef6ee4339 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.165844 May 11 06:41:42.729244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 164/335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:42 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:42.941811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:42.942552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:42.949372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:42.949936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:42.951503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:42.952033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:43.075951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:43.077623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:43.084894 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:43.086030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:43.086989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:43.087610 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:43.100801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:43.109602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:43.111377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:43.112282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1b2038d4-4439-4032-92c1-04628c50d1bc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.174345 May 11 06:41:43.112840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 172/336] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:42 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:43.224129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:43.231523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3f7348d2-0a57-409d-9b1b-e1b48f329f0f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.161032 May 11 06:41:43.232637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 165/337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:43 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:43.745628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:43.746317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:43.752596 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:43.753141 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:43.754008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:43.754508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:43.887030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:43.894260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c6e7b4c4-6e72-4a94-b362-ab96b22bdbd6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.152666 May 11 06:41:43.894828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 173/338] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:43 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:44.131206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:44.131974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:44.137888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.138351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.139115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.139568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.249454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:44.250582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:44.257682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.258242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.259256 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.259806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.270698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:44.282485 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:44.284525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:44.286144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-41a9022b-7db3-41f1-8359-c654a122294e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.158616 May 11 06:41:44.286915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 166/339] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:44 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:44.396628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:44.404558 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3698ab64-9181-4d2f-9b74-7e1009833ade tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.158921 May 11 06:41:44.405356 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 174/340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:44 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:44.797560 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:44.798049 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:44.803930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.804375 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.805180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.805617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.829084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d8f618c4-fc29-4720-81ce-4e7703e98f93 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/ips" status: 200 len: 151 microversion: 2.1 time: 0.035403 May 11 06:41:44.829647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 167/341] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:41:44 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:41:44.912096 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:44.913286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:44.920518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.922998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:44.922998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:44.923325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.016361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-a1f8b087-12d4-4a1d-81d5-e8334c5bad46 req-a8e66cb8-ffa2-46cc-9175-35b868ef25d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e5702-6dc0-4ad4-83d4-e955f6017d38", "name": "network-vif-plugged", "status": "completed", "tag": "2a7723b1-e98a-4b60-b0dd-58e2ffc809bc"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:45.025823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a1f8b087-12d4-4a1d-81d5-e8334c5bad46 req-a8e66cb8-ffa2-46cc-9175-35b868ef25d3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:45.026643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a1f8b087-12d4-4a1d-81d5-e8334c5bad46 req-a8e66cb8-ffa2-46cc-9175-35b868ef25d3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.038673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-a1f8b087-12d4-4a1d-81d5-e8334c5bad46 req-a8e66cb8-ffa2-46cc-9175-35b868ef25d3 service nova] Creating event network-vif-plugged:2a7723b1-e98a-4b60-b0dd-58e2ffc809bc for instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 on hv-cinder-80475 May 11 06:41:45.045221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-a1f8b087-12d4-4a1d-81d5-e8334c5bad46 req-a8e66cb8-ffa2-46cc-9175-35b868ef25d3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 May 11 06:41:45.047221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 168/342] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:41:45.074820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:45.083786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a8a724dc-fe6c-47f5-9c95-67c9e21df84c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.176614 May 11 06:41:45.084361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 175/343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:44 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:45.306640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:45.307368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:45.313584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:45.314112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.314896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:45.315449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.421380 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:45.421936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:45.428007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:45.428452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.429456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:45.430062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:45.453134 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:45.460843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:45.462370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:45.463545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6a589579-e9cf-43c2-8199-f88fc67d05f8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.161216 May 11 06:41:45.464094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 169/344] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:45 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:45.558338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:45.565563 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6f96337a-2770-4f85-9944-49be31850482 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.148206 May 11 06:41:45.566123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 176/345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:45 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:46.101337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:46.102180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:46.109282 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.109719 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.110684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.111069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.234410 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b2c04b-6959-40a7-82a5-2dc9943fd297"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:46.235600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:46.241861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.242309 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.243083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.243559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.263058 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:46.270400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-30cc3863-c54f-4045-a242-fddf8d48e904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.173328 May 11 06:41:46.270999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 170/346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:46 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:46.481631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:46.482789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:46.488659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.489111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.489911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.490345 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.621310 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:46.629024 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:46.630513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:46.631711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6f8e1e99-96e5-4100-a6e9-fa15387422eb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.154010 May 11 06:41:46.632258 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 171/347] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:46 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:46.636650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:46.637244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:46.643072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.643563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.644331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:46.644766 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:46.770753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:46.777999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d583fbb3-4c6b-4830-9adf-3963e9b0345c tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.144759 May 11 06:41:46.778598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 172/348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:46 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:47.288045 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:47.288657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:47.295164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.295637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.296395 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.296833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.423195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:47.433482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fff879ea-33df-422f-a1a6-fd5baeff796d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.149199 May 11 06:41:47.434064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 173/349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:47 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:47.649921 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:47.650527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:47.657045 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.657490 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.658240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.658670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.781794 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:47.789801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:47.791387 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:47.792537 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-39539ea2-1029-426e-b696-ac7015e8fd57 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.146475 May 11 06:41:47.793085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 174/350] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:47 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:47.797409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:47.798010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:47.803333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.803840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.804597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:47.805029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:47.930901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:47.938726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2a7044f7-a7ad-47fa-83ef-305f849785c7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.144714 May 11 06:41:47.939322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 175/351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:47 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:48.450249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:48.450887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:48.456890 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.457336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:48.458084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.458567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:48.588286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:48.596007 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c1b3c006-f5a3-4067-9479-aa7428b38f82 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.149965 May 11 06:41:48.596568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 176/352] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:48 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:48.810730 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:48.811292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:48.817083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.817521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:48.818265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.818693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:48.943995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:48.952518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:48.953994 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:48.955129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e21719e6-caf1-4227-9fc1-76471fd5fa2b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.148656 May 11 06:41:48.955719 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 177/353] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:48 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:48.959905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:48.960494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:48.965810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.966268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:48.967014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:48.967464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:49.094108 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:49.101276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7fa9146b-1ab1-49ed-a887-f409b5bd1c68 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1313 microversion: 2.1 time: 0.144646 May 11 06:41:49.101836 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 178/354] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:48 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:49.613134 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:49.613740 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:49.619586 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:49.620036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:49.620792 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:49.621225 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:49.747688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:49.755083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bd67c58e-8ae9-478e-a780-39161d35d36e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.145802 May 11 06:41:49.755680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 179/355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:49 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:49.973280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:49.973897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:49.979654 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:49.980098 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:49.980846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:49.981296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.109228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.116962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.118441 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.119675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1f95944b-368f-40e2-82b7-1ad1341d9b7b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.150250 May 11 06:41:50.120222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 180/356] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:49 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:41:50.124978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:50.125566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:50.130953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.131418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.132165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.132588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.257102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.264892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-83e68048-8d13-402e-b3bb-646160da635b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1463 microversion: 2.1 time: 0.143755 May 11 06:41:50.265447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 181/357] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:50 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:50.301933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:50.302421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:50.308144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.308595 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.309339 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.310262 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.334504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:41:50.410268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cf6db3a4-fac2-467e-905b-40ba4b20a6d2 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 204 len: 0 microversion: 2.1 time: 0.111470 May 11 06:41:50.410858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 182/358] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:41:50 2022] DELETE /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:41:50.419369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:50.420291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:50.426065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.426521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.427310 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.427755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.565251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.573557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6be594cb-b802-4f4b-8a35-6a83c7490115 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1469 microversion: 2.1 time: 0.157933 May 11 06:41:50.575303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 183/359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:50 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:50.587841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5cc06b2f-20b1-4467-b8f7-872f3ddfa6c1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.360483 May 11 06:41:50.588533 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 177/360] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:41:46 2022] POST /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 194 bytes in 4362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:41:50.772306 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:50.772823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:50.778652 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.779091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.779879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:50.780306 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:50.909469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:50.916608 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b4002736-8b9f-4122-8f92-fcf4527f6c1a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.148232 May 11 06:41:50.917166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 184/361] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:50 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:51.139158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:51.139881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:51.146730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.147181 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:51.147965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.148401 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:51.279131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:51.286877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:51.288341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:51.289480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7d1363c4-5c06-4a3c-9a6f-3594cbbfbba3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.154955 May 11 06:41:51.290040 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 178/362] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:51 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:51.591133 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:51.592399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:51.598101 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.598537 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:51.599298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.599726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:51.730537 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:51.737778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7cfb719f-1854-449e-ba64-c72a94a53086 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1469 microversion: 2.1 time: 0.150529 May 11 06:41:51.738347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 185/363] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:51 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:51.933724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:51.934343 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:51.941804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.942289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:51.943063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:51.943605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:52.074354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:52.081517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-05eae209-1f6d-412d-87a5-f0529d6ec98d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.151609 May 11 06:41:52.082256 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 179/364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:51 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:52.307953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:52.308554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:52.314913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:52.315383 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:52.316179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:52.316561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:52.453726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:52.461666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:52.463074 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:52.464300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e720783f-e193-4e14-8819-c5a28bcf09f1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.160186 May 11 06:41:52.464855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 186/365] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:52 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:52.754108 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:52.754741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:52.761068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:52.761512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:52.762258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:52.762685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:52.899806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:52.907400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d48a8f3f-0154-4b81-aa99-f77fbc4f852b tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1469 microversion: 2.1 time: 0.157068 May 11 06:41:52.907962 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 180/366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:52 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:53.099207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:53.100494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:53.107020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.107331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.108347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.108715 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.254360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:53.261670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a17707b9-18ef-4c21-8278-e3161f31ab6c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.167191 May 11 06:41:53.262242 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 187/367] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:53 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:53.484442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:53.485156 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:53.491651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.492211 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.496793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.497484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.542983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-45ab3a5f-72a1-44e2-aeff-a4abbe987298 req-c7acc43b-6f64-453d-881a-9aec95ff9ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e5702-6dc0-4ad4-83d4-e955f6017d38", "name": "network-vif-deleted", "tag": "2a7723b1-e98a-4b60-b0dd-58e2ffc809bc"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:41:53.551752 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-45ab3a5f-72a1-44e2-aeff-a4abbe987298 req-c7acc43b-6f64-453d-881a-9aec95ff9ff4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.553945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-45ab3a5f-72a1-44e2-aeff-a4abbe987298 req-c7acc43b-6f64-453d-881a-9aec95ff9ff4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.568748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-45ab3a5f-72a1-44e2-aeff-a4abbe987298 req-c7acc43b-6f64-453d-881a-9aec95ff9ff4 service nova] Creating event network-vif-deleted:2a7723b1-e98a-4b60-b0dd-58e2ffc809bc for instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 on hv-cinder-80475 May 11 06:41:53.577262 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-45ab3a5f-72a1-44e2-aeff-a4abbe987298 req-c7acc43b-6f64-453d-881a-9aec95ff9ff4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037806 May 11 06:41:53.578424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 188/368] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:41:53.663018 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:53.676406 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:53.677914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:53.679142 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e1c49329-3777-4f77-8c40-b21c49915f05 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.199907 May 11 06:41:53.680368 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 181/369] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:53 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:53.925246 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:53.926084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:53.932633 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.933082 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:53.933915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:53.934505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:54.004309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:54.011791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3eea8092-1b72-4760-90fa-a477d6041de7 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1427 microversion: 2.1 time: 0.090820 May 11 06:41:54.012247 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 189/370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:53 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:54.279205 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:54.279780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:54.286015 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:54.286464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:54.287240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:54.287698 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:54.436204 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:54.444614 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-81c9ae6f-120c-4962-8ac9-73064242830b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.170011 May 11 06:41:54.445763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 182/371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:54 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:54.700261 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:54.700885 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:54.706927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:54.707411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:54.708164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:54.708587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:54.836180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:54.844232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:54.845728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:54.849798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-78071f3c-a4ac-48a1-a3a3-cb141b705e94 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.150878 May 11 06:41:54.849798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 190/372] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:54 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:55.029199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:55.029807 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:55.035688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.036138 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.036968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.037401 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.067005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.067492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.067950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lazy-loading 'fault' on Instance uuid 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:55.110730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:55.117806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-711729d3-45a8-4f8a-8b90-4205757380d5 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1303 microversion: 2.1 time: 0.092918 May 11 06:41:55.118361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 183/373] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:55 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:55.462906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:55.463542 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:55.470020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.470467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.471225 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.471683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.594512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:55.601958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e1b179c9-df1a-41fa-b83c-424125780c68 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.142967 May 11 06:41:55.602530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 191/374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:55 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:55.865768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:55.866367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:55.873097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.873543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:55.874296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:55.874729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.005601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:56.013822 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:56.015348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:56.016494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-020a59b4-2db4-4591-afb1-0a06072baad9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.154520 May 11 06:41:56.017054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 184/375] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:55 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:56.133700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:56.134310 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:56.140792 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:56.141241 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.142039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:56.142474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.171822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:56.172264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.172707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lazy-loading 'fault' on Instance uuid 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:56.212596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:56.219751 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-01add9dd-9eaf-4a90-8c11-7ab44f84d968 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1303 microversion: 2.1 time: 0.089845 May 11 06:41:56.220314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 192/376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:56 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:56.617817 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:56.618423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:56.624501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:56.624942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.625694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:56.626123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:56.752275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:56.759385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-edc190d9-4fb4-4278-b029-f10d9bb89b3e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.145360 May 11 06:41:56.765042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 185/377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:56 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:57.033934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:57.034547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:57.040520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.040979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.041834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.042344 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.170984 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:57.178683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:57.180209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:57.181365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e8b41a26-ac8b-49f0-bde5-4a512fc597e9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.151368 May 11 06:41:57.181919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 193/378] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:57 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:57.237053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:57.237648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:57.244259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.244700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.245488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.245911 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.279577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.280028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.280477 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lazy-loading 'fault' on Instance uuid 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:57.319855 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:57.327102 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cc408e1c-4296-40fb-ab73-afb5ee2a1fae tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1303 microversion: 2.1 time: 0.094167 May 11 06:41:57.327695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 186/379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:57 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:57.776932 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:57.777581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:57.784055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.784510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.785278 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:57.785713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:57.912818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:57.920153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e427add4-9009-4434-b6b6-4b11ea006723 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.147138 May 11 06:41:57.920714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 194/380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:57 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:58.203578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:58.204175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:58.210182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.210629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.211409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.211837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.338591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:58.342796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:58.343433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:58.346629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:58.348158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:58.349132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.349310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0a9d994b-3ca2-4596-ab0a-1a41b6b66ad3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.150281 May 11 06:41:58.349576 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.350044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 187/381] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:58 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:41:58.350336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.350766 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.381269 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.381718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.382254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lazy-loading 'fault' on Instance uuid 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:41:58.424783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e36b0835abc4beebe51d1a6f71ef9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566cec90becf440c860b261b3153e5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:58.432824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-21a07f15-8932-454e-85ed-5a67b4b6f83f tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 200 len: 1303 microversion: 2.1 time: 0.093162 May 11 06:41:58.432824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 195/382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:58 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:41:58.936746 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:58.937356 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:58.943186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.943671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:58.944440 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:58.944879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:59.105190 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:59.113064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3806f2e9-97af-4ad3-b4a9-a2e112870326 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.180114 May 11 06:41:59.113631 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 188/383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:58 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:41:59.368566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:59.369203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:59.375355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:59.375829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:59.376594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:59.377031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:59.449999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:41:59.450542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] [instance: 3f6e5702-6dc0-4ad4-83d4-e955f6017d38] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:41:59.457603 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:59.458055 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:59.458822 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:41:59.459275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:41:59.474627 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] HTTP exception thrown: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Request method failure captured: May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 HTTP/1.1 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1qcgoIYnMqTpQED95VDAyoQjzis2vASHJ0u4dDHoYg59tczfIfv_OQ7b_9_lfwyjnpzw4Qn6RkUv0Vf212Ss9wHCexbU7W22KrLQQOoW3GTJPUGhinZAOXn7XG3zK3sRLwOQVRZiOWBD_AIZx6AYHZAeO-FFh3PxRCRQlFZdEVsl-8 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 566cec90becf440c860b261b3153e5d6 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesNegativeTest-641066020 May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:41:59.476296 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/566cec90becf440c860b261b3153e5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_566cec90becf440c860b261b3153e5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/566cec90becf440c860b261b3153e5d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/566cec90becf440c860b261b3153e5d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesNegativeTest-641066020 May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 566cec90becf440c860b261b3153e5d6 May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesNegativeTest-641066020 May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesNegativeTest-641066020-project May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 5e36b0835abc4beebe51d1a6f71ef9fc May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesNegativeTest-641066020-project May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. May 11 06:41:59.477593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '3f6e5702-6dc0-4ad4-83d4-e955f6017d38'} May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:41:59.478291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. May 11 06:41:59.479697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:41:59.480976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] Returning 404 to user: Instance 3f6e5702-6dc0-4ad4-83d4-e955f6017d38 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:41:59.480976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-732d5289-da9a-4e89-855e-cabaf7c753a1 tempest-VolumesNegativeTest-641066020 tempest-VolumesNegativeTest-641066020-project] 10.222.0.64 "GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38" status: 404 len: 111 microversion: 2.1 time: 0.031926 May 11 06:41:59.480976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 189/384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:41:59 2022] GET /compute/v2.1/servers/3f6e5702-6dc0-4ad4-83d4-e955f6017d38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:41:59.507774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:59.516460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:59.517982 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:41:59.519139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ecade349-d3a8-4ca0-8bf1-162b54fb676b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.154463 May 11 06:41:59.525022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 196/385] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:41:59 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:00.129973 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:00.130684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:00.137215 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.137831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.139159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.139770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.272693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:00.280584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4f8d69c3-a8bd-4217-b680-8f429034f5dc tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1501 microversion: 2.1 time: 0.154538 May 11 06:42:00.281189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 190/386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:00 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:00.298148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1516531d-4923-4b42-8326-5ebb2588c7f0"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:00.299232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:00.306365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.307124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.308515 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.309322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.337971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] HTTP exception thrown: Cannot 'attach_volume' instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 while it is in vm_state rescued May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Request method failure captured: May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/os-volume_attachments HTTP/1.1 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 74 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oVFNC3chn7NkOA_8EUeVavAZOmL4jJPOIePeS4PmnZDqh1iOO0IHhqfL8svd_gFAEWel3AClgmqc2APtM42fKrqSpdfT3EC3PAD_F6t86viWoyVXa8Ps7SQnsTQQPz06Z8DhCRcbmuvR9XM4PUckdDLGL_FrY3lZUBl6n3HIZzZA4 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:42:00.339923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 0334273a56994a7abfa3d72006f7a7a4 May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {"volumeAttachment": {"volumeId": "1516531d-4923-4b42-8326-5ebb2588c7f0"}} May 11 06:42:00.341220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Cannot 'attach_volume' instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 while it is in vm_state rescued May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'server_id': 'acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915', 'body': {'volumeAttachment': {'volumeId': '1516531d-4923-4b42-8326-5ebb2588c7f0'}}} May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:42:00.342455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 while it is in vm_state rescued May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:42:00.343509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 while it is in vm_state rescued May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Returning 409 to user: Cannot 'attach_volume' instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 while it is in vm_state rescued {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-65aaf27a-c8ba-4d47-8f41-c194c1898ef3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048617 May 11 06:42:00.344643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 197/387] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:42:00 2022] POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 11 06:42:00.350882 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:00.351509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:00.365948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.365948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.365948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.365948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.432654 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1b80d73e-4f6d-4df2-a3be-f989f8bf4922 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/action" status: 202 len: 0 microversion: 2.1 time: 0.084783 May 11 06:42:00.432783 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 191/388] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:42:00 2022] POST /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:42:00.440749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:00.441359 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:00.448112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.448572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.449369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.449800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.539600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:00.540371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:00.547586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.548044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.548814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:00.549413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:00.607247 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:00.624687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-693408f6-e454-4dc9-b360-8d77b5234ed0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1509 microversion: 2.1 time: 0.179779 May 11 06:42:00.624687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 198/389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:00 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:00.696177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:00.705398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:00.707021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:00.708270 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-60e33ca5-a08d-4d14-bc0e-6484191bfb93 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.172940 May 11 06:42:00.708977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 192/390] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:00 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:01.634062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:01.634747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:01.641330 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:01.641875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:01.642874 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:01.643448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:01.726358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:01.727088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:01.734748 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:01.735214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:01.736468 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:01.737092 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:01.791791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:01.799535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-902a7d2e-bc9b-4c2b-9c9c-a5eab8c6aa57 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1509 microversion: 2.1 time: 0.169533 May 11 06:42:01.800467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 199/391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:01 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:01.886659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:01.895508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:01.897136 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:01.898421 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e16a445f-df0a-45c1-9d0b-91891e518077 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.176186 May 11 06:42:01.899107 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 193/392] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:01 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:02.818894 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:02.820356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:02.828017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:02.828720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:02.829825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:02.830588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:02.918304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:02.918906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:02.934932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:02.936045 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:02.936846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:02.937307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:03.018314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:03.025881 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2e113118-4691-4e3e-b320-34515c4ae64f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1509 microversion: 2.1 time: 0.212400 May 11 06:42:03.035758 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 200/393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:02 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:03.109588 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:03.119951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:03.122563 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:03.124644 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c5c983d3-defa-4b7d-b418-a8627f477e29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.210548 May 11 06:42:03.125366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 194/394] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:02 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:03.413145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-654848c5-46d6-45e0-9529-2dacf22c8c9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: .version_select at 0x7fc5c8dd2ee0>, body: {"keypair": {"name": "tempest-keypair-1642098924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBiJ8Yx4/W1er10GQpDCUah7UbSQP7/QYq4eCwWXeQO/bdkB1njUpl5jYCqh7gTp2saVp+7K/8LzADNITnnc8YHjhstTgMguQXfV5HCAmP+GjFzRnoVG3Yq9rNW8w3fCw=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:03.429043 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-654848c5-46d6-45e0-9529-2dacf22c8c9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:42:03.434472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-654848c5-46d6-45e0-9529-2dacf22c8c9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:42:03.459780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-654848c5-46d6-45e0-9529-2dacf22c8c9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055448 May 11 06:42:03.460458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 201/395] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:42:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:04.042465 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:04.047073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:04.057176 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:04.058517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:04.059544 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:04.060715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:04.149662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:04.150320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:04.158148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:04.158622 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:04.159453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:04.159892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:04.347146 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:04.355090 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e5b0b71e-de6d-4068-98aa-bee1f20b7e9a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1509 microversion: 2.1 time: 0.316994 May 11 06:42:04.355708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 195/396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:04 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:04.366435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-667e1d35-a5c8-4be6-9d06-9cf9bb83ff0e req-b0d25974-0ae2-460a-901d-a8c927d683e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "name": "network-vif-plugged", "status": "completed", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:04.380360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-667e1d35-a5c8-4be6-9d06-9cf9bb83ff0e req-b0d25974-0ae2-460a-901d-a8c927d683e7 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:04.380924 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-667e1d35-a5c8-4be6-9d06-9cf9bb83ff0e req-b0d25974-0ae2-460a-901d-a8c927d683e7 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:04.395555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-667e1d35-a5c8-4be6-9d06-9cf9bb83ff0e req-b0d25974-0ae2-460a-901d-a8c927d683e7 service nova] Creating event network-vif-plugged:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:42:04.406734 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-667e1d35-a5c8-4be6-9d06-9cf9bb83ff0e req-b0d25974-0ae2-460a-901d-a8c927d683e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045548 May 11 06:42:04.410678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:04.414509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 196/397] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:04.419308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:04.421564 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:04.422948 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cd410d4a-36c0-482f-880d-7ccde13e4606 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.280397 May 11 06:42:04.423856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 202/398] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:04 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:05.216190 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-48128786", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e699df-3755-47eb-b019-c5436429fdb7"}], "security_groups": [{"name": "tempest-securitygroup--2055493308"}], "key_name": "tempest-keypair-1642098924", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:05.375125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:05.375794 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:05.382098 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:05.382557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:05.383367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:05.383964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:05.414942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] validate_networks() for [('61e699df-3755-47eb-b019-c5436429fdb7', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:42:05.891434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:05.901700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5e2daf39-7247-4a49-a03e-e5ebb9e4956d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1509 microversion: 2.1 time: 0.530485 May 11 06:42:05.919427 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 203/399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:05 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1509 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:05.924731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:05.926261 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:05.937682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:05.938384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:05.939884 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:05.940620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:06.286899 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:42:06.288621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:42:06.289304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:42:06.289950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:42:06.290323 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:06.290857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:42:06.299361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:06.300864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:06.304290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:06.306198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a72de510-63fc-4106-8fb8-0129103f40b5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1745 microversion: 2.20 time: 0.381135 May 11 06:42:06.307502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 204/400] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:05 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1745 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:06.308980 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:06.310695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:06.311422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:06.341178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:42:06.345329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:42:06.356514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:42:06.359459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:42:06.419551 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c6212bbe-cf30-4c8d-8521-c20430e892c9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.208594 May 11 06:42:06.420651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 197/401] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:42:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:42:06.430728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1a366188-7c06-4bb7-ac9f-2e87f3b922cf tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:06.432146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1a366188-7c06-4bb7-ac9f-2e87f3b922cf tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:06.496709 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1a366188-7c06-4bb7-ac9f-2e87f3b922cf tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:06.512570 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1a366188-7c06-4bb7-ac9f-2e87f3b922cf tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1240 microversion: 2.1 time: 0.085458 May 11 06:42:06.513308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 205/402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:06 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:06.919768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:06.920392 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:06.926515 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:06.926964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:06.927825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:06.928261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:07.091966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:07.099188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-16c5b7c4-131d-4f99-9ef2-beb86db23f61 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1515 microversion: 2.1 time: 0.183753 May 11 06:42:07.099784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 198/403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:06 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:07.329212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:07.329980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:07.336521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:07.336971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:07.338377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:07.338820 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:07.482651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:07.492164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:07.493684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:07.494841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3372b558-e14c-402f-9144-85837991fc33 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.170358 May 11 06:42:07.495415 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 206/404] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:07 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:07.530123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:07.530633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:07.536891 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:07.537620 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:07.539622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:07.540063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:07.603977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:07.611639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c677b891-a30e-46ba-9476-cd55a428b49f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1292 microversion: 2.1 time: 0.085423 May 11 06:42:07.612200 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 199/405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:07 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:07.727950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-193276018", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "networks": [{"uuid": "755ee928-3089-4dea-bd5b-18623aa24349"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:07.777135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] validate_networks() for [('755ee928-3089-4dea-bd5b-18623aa24349', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:42:08.180954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:42:08.181406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:42:08.181918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:42:08.182365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:42:08.182950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:42:08.193689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.194499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.195576 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.196259 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.220397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Getting quotas for project 05347ecf2f1e4379bfa0f96c9df28c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:42:08.225052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Getting quotas for user 55f7b1ca4478415c9b526c4e4b9e3ca2 and project 05347ecf2f1e4379bfa0f96c9df28c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:42:08.241421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:42:08.244364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:42:08.296271 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ba4e7a7b-ef96-4e38-ada6-899d6477f5b7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572111 May 11 06:42:08.301663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 207/406] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:42:08.306920 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d318da76-6cbd-4660-ab2b-42df4e29d570 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:08.307463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d318da76-6cbd-4660-ab2b-42df4e29d570 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:08.395206 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d318da76-6cbd-4660-ab2b-42df4e29d570 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:08.403283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d318da76-6cbd-4660-ab2b-42df4e29d570 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1218 microversion: 2.1 time: 0.100108 May 11 06:42:08.405121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 200/407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:08 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:08.481252 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-13ebc76b-464d-43c7-9d03-520912f5a7cf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: .version_select at 0x7fc5c8dd25e0>, body: {"keypair": {"name": "tempest-keypair-1656099014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrBYdgpVV90Du4z0axWVJphGJ8PmqPpqfaUTSC/oYHUL7OGD7TRZ5X0Iy1ZdlVKP96rH6S6TI2SvWk2LaFnaMtu2VQ5wvgElaFypElU/dw9ATdpXGCDcftMqmyrTVjSLA=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:08.515810 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:08.516531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:08.524013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-13ebc76b-464d-43c7-9d03-520912f5a7cf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:42:08.529767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-13ebc76b-464d-43c7-9d03-520912f5a7cf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for user 0334273a56994a7abfa3d72006f7a7a4 and project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:42:08.533278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.534146 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.535140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.536097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.586619 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-13ebc76b-464d-43c7-9d03-520912f5a7cf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110975 May 11 06:42:08.588499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 208/408] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:42:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:08.628745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:08.630006 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:08.645930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.646685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.650640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:08.651985 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:08.782216 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:08.795827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f34023d9-00d1-4010-a76f-38b6b09858d9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1298 microversion: 2.1 time: 0.170815 May 11 06:42:08.799981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 209/409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:08 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:08.877779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:08.894129 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:08.898455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:08.901416 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a39a891a-cde9-4818-9fe7-99e066991cce tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.391250 May 11 06:42:08.912379 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 201/410] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:08 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:09.424452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:09.430310 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:09.441965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.444028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:09.445510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.446149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:09.566566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:09.582171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-67b75b42-21cb-4311-b537-0857251cc18e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1270 microversion: 2.1 time: 0.159657 May 11 06:42:09.584731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 210/411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:09 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:09.818391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:09.819900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:09.828450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.829395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:09.830399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.831184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:09.923705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:09.924844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:09.935518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.939523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:09.943951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:09.944862 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:10.294056 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:10.303291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e8d0ae28-b1ce-4b27-9f28-b24cdce86b9b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.489950 May 11 06:42:10.303904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 202/412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:09 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:10.315256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:10.328989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:10.331197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:10.332695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2bf4d3fd-f2cf-47ba-a377-29efd8b54665 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.414865 May 11 06:42:10.333500 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 211/413] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:09 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:10.604694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:10.605832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:10.628859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:10.632673 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:10.635027 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:10.640208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:10.825503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:10.840153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-42a19be1-3d02-4d6f-93a6-874ac0079957 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1276 microversion: 2.1 time: 0.240416 May 11 06:42:10.841010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 203/414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:10 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:11.139916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-237b7bc3-7dd0-4454-a864-2b15cca66aae req-5c8e2673-3f05-46e6-a66a-165ac671880d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f9778e-fe70-41f8-b12c-d55c6aa0ade9", "tag": "878b5dad-3ac4-42a4-af88-930587b53519"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:11.149085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-237b7bc3-7dd0-4454-a864-2b15cca66aae req-5c8e2673-3f05-46e6-a66a-165ac671880d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.149542 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-237b7bc3-7dd0-4454-a864-2b15cca66aae req-5c8e2673-3f05-46e6-a66a-165ac671880d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.209118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-237b7bc3-7dd0-4454-a864-2b15cca66aae req-5c8e2673-3f05-46e6-a66a-165ac671880d service nova] Creating event network-changed:878b5dad-3ac4-42a4-af88-930587b53519 for instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 on hv-cinder-80475 May 11 06:42:11.226950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-237b7bc3-7dd0-4454-a864-2b15cca66aae req-5c8e2673-3f05-46e6-a66a-165ac671880d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090842 May 11 06:42:11.228212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 212/415] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:11.321221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:11.322078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:11.333782 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.334415 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.335758 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.343463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.352093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:11.352799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:11.362058 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.362513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.363314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.363758 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.682865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:11.689142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:11.697261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3ecef9da-d068-4b0d-aae1-3569986f2df3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.380798 May 11 06:42:11.698474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:11.701170 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:11.702971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 204/416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:11 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:11.714710 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1ef21964-f3f1-4733-9c9e-ea12cf07d7e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.366510 May 11 06:42:11.716010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 213/417] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:11 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:11.722017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2050134020", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f58da4c7-ef95-435b-ab0f-347f8d529b37"}], "security_groups": [{"name": "tempest-securitygroup--408841892"}], "key_name": "tempest-keypair-1656099014", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:11.863185 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:11.863771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:11.870856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.871924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:11.872951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:11.873539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:12.072396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:12.080431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0ee5144-dd44-4956-aebf-7eecba097cd6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.225751 May 11 06:42:12.081560 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 214/418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:11 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:12.725096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:12.726825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:12.736411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:12.737102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:12.739856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:12.740714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:12.910204 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:12.918805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-29212bff-b090-45e0-801d-ba011e780d1e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.198223 May 11 06:42:12.919424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 215/419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:12 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:12.925841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:12.926763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:12.932943 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:12.933492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:12.934460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:12.935980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:13.107353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:13.117944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:13.119627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:13.121190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4ed7a53c-0057-4805-b846-e72e54d5c1e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.200635 May 11 06:42:13.121939 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 216/420] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:12 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:13.133945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:13.136406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:13.145026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:13.145822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:13.147908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:13.151221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:13.342309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:13.350022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f6f15551-aae4-4663-b409-9c7638391650 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.225427 May 11 06:42:13.350643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 217/421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:13 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:13.365260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-6dba42c1-1d92-4fc8-b109-81b8e0680242 req-157e527b-aa0d-4689-99e3-e16b25d017ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac5bc3a-4844-477e-a612-c18b8f0b9723", "tag": "cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:13.378086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-6dba42c1-1d92-4fc8-b109-81b8e0680242 req-157e527b-aa0d-4689-99e3-e16b25d017ed service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:13.378529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-6dba42c1-1d92-4fc8-b109-81b8e0680242 req-157e527b-aa0d-4689-99e3-e16b25d017ed service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:13.390974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-6dba42c1-1d92-4fc8-b109-81b8e0680242 req-157e527b-aa0d-4689-99e3-e16b25d017ed service nova] Creating event network-changed:cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e for instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 on hv-cinder-80475 May 11 06:42:13.396125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-6dba42c1-1d92-4fc8-b109-81b8e0680242 req-157e527b-aa0d-4689-99e3-e16b25d017ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034995 May 11 06:42:13.396908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 218/422] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:13.936216 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:13.937834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:13.946498 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:13.946953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:13.948159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:13.948846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:14.112160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:14.120461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da25a964-57b8-435a-bec7-103ed207d3ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.188686 May 11 06:42:14.123646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 219/423] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:13 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:14.143132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:14.143721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:14.151490 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:14.151956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:14.152723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:14.153156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:14.311208 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:14.320837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:14.322455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:14.324007 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-19f3eaca-8f0a-43a6-b36a-95210f32a214 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.187086 May 11 06:42:14.325033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 220/424] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:14 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:14.367429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:14.368114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:14.374402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:14.374924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:14.376142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:14.376573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:14.521210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:14.529827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fbf197bb-0e73-4328-ba7f-4b950ba5f1b1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.166363 May 11 06:42:14.534700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 221/425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:14 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:15.137477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:15.138203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:15.144580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.145378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.146153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.146758 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.297879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:15.306425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cc1e49e3-6469-40a0-b3d9-d0ca4e796649 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.172958 May 11 06:42:15.307572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 222/426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:15 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:15.344023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:15.344673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:15.352150 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.352619 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.353658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.354145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.510721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:15.519178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:15.520731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:15.521902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-69488bad-f223-44d8-bf6b-a210d2a4239d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.182696 May 11 06:42:15.522459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 223/427] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:15 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:15.546545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:15.547188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:15.553978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.554423 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.555193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:15.555662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:15.697810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:15.711300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0b9e7d74-57db-4210-8663-90d0f6133dbe tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.166090 May 11 06:42:15.719289 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 224/428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:15 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:16.324550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:16.328085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:16.336789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.337324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.339045 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.339628 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.507954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:16.516007 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-77cad94d-b4c5-49f3-9b24-d0944f466bc3 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.195976 May 11 06:42:16.527674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 225/429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:16 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:16.540753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:16.541447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:16.548602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.549139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.550010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.550514 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.705264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:16.715931 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:16.718035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:16.719231 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d6ed5447-bf6d-4611-8816-eedd3bee6ceb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.182479 May 11 06:42:16.720020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 226/430] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:16 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:16.729956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:16.730581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:16.737149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.737565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.738341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:16.738809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:16.897791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:16.912255 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-189b0123-939e-4514-84ae-e5327561e3f1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.186117 May 11 06:42:16.919363 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 227/431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:16 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:17.535698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:17.536349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:17.542704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.543223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:17.543973 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.544983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:17.684175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:17.692109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-04ea1844-ebd3-4eef-b868-8a37f745b84c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.160263 May 11 06:42:17.695308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 228/432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:17 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:17.739253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:17.739934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:17.749202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.749657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:17.750436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.750874 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:17.906752 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:17.921898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:17.924210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:17.927980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1778becb-c861-4e4b-99a2-34d47a0502d4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.192860 May 11 06:42:17.928720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 229/433] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:17 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:17.934434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:17.935009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:17.941110 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.941699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:17.942473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:17.942905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:18.098929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:18.106076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cf418c6b-42aa-414c-a323-a9e44e6b9511 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.176337 May 11 06:42:18.106686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 230/434] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:17 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:18.540014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] validate_networks() for [('f58da4c7-ef95-435b-ab0f-347f8d529b37', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:42:18.708798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:18.709413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:18.724047 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:18.724501 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:18.725291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:18.726054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.003726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.015293 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aa72356e-f411-4507-b98b-0888cc08e271 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.307214 May 11 06:42:19.024746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 231/435] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:18 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:19.030426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:19.031059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:19.040733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.041097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.041883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.042468 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.168976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:42:19.170438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:42:19.170948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:42:19.171413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:42:19.171833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:42:19.181044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.181494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.182291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.182723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.202185 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:42:19.206806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Getting quotas for user 0334273a56994a7abfa3d72006f7a7a4 and project 0d1689ff62644e0c92c3bf8290b52b90. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:42:19.220009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:42:19.220420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.222125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:42:19.229098 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.230677 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.232611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-84d06590-13c5-49d1-a42a-3b978ea7952b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.214581 May 11 06:42:19.233186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 232/436] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:19 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:19.237706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:19.238301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:19.244497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.244947 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.245705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:19.246136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:19.292621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3ffcc2d9-65c4-4d35-a823-a74b7e854123 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 7.587643 May 11 06:42:19.293286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 205/437] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:42:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 7590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:42:19.304088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5f5add94-f654-4e43-811c-c02b2b23160e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:19.304701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5f5add94-f654-4e43-811c-c02b2b23160e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:19.401987 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5f5add94-f654-4e43-811c-c02b2b23160e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.410260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5f5add94-f654-4e43-811c-c02b2b23160e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1246 microversion: 2.1 time: 0.110023 May 11 06:42:19.411452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 206/438] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:19 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:19.457899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:19.465362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aaea878f-f616-4305-89e5-7d8782a83512 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.231079 May 11 06:42:19.466127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 233/439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:19 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:20.032321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:20.032933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:20.039226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.039711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.040479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.040919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.166079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.173786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0c0e4ae8-55b4-4e16-8885-6e252e4d0b0c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.145349 May 11 06:42:20.174340 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 207/440] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:20 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:20.251171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:20.251744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:20.257596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.258040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.258813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.259233 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.384097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.391697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.393187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.394324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3eb0abb4-d765-42e2-a0d0-8c0a2c91bc36 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.147655 May 11 06:42:20.394882 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 234/441] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:20 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:20.427314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:20.427926 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:20.434052 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.434496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.435934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.436366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.483049 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:20.484520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:20.492671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.493123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.494148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:20.494930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:20.499605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.508304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0dabb1c5-ef12-4bc4-8c6b-f3389a3dbfcd tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1250 microversion: 2.1 time: 0.084694 May 11 06:42:20.508813 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 208/442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:20 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:20.625850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:20.633079 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cadeadfc-5844-4b59-a790-96b46a442044 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.154929 May 11 06:42:20.633641 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 235/443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:20 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:21.190818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:21.191477 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:21.197785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.198492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.199258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.199724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.329159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.336334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-47e496f1-e928-4c25-8db1-9ca62213e85f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.150209 May 11 06:42:21.336902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 209/444] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:21 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:21.412216 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:21.412732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:21.418626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.419079 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.419857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.420303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.524658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:21.525364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:21.531442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.531959 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.532789 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.533318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.548261 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.556127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.557647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.558773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-353e7e60-7de7-430f-a940-6c5a96a07440 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1740 microversion: 2.20 time: 0.150615 May 11 06:42:21.559348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 236/445] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:21 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:21.595240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.603830 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b8665220-589a-4413-ae57-f1c5e3c326a0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1298 microversion: 2.1 time: 0.083163 May 11 06:42:21.604415 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 210/446] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:21 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:21.654257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:21.655105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:21.660986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.661431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.662185 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:21.662668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:21.788029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:21.795151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-93d7e7f1-8664-456c-9159-9f59bd5ffffc tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.145448 May 11 06:42:21.795748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 237/447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:21 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:22.353667 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:22.354427 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:22.361391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.361840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.362615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.363049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.522422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.535947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bdfc810c-a1c3-48fd-86c5-2ba373a88a75 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.186070 May 11 06:42:22.536700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 211/448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:22 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:22.578063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:22.578670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:22.585250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.585697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.586465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.586897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.621803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:22.622151 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:22.629586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.630040 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.630819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.631259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.706831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.714965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7f0df235-716c-4def-8876-661d1e959f9f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1304 microversion: 2.1 time: 0.097779 May 11 06:42:22.715767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 212/449] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:22 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:22.769670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.778353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.779946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.781419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da304ef7-08e3-4da5-b91a-4b8c2a227f8f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1722 microversion: 2.20 time: 0.207318 May 11 06:42:22.782061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 238/450] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:22 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:22.811767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:22.812471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:22.818419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.818957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.819820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:22.820346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:22.954949 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:22.962716 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-81f4d0c8-9f3e-475e-8439-df6ba51eae1f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.155215 May 11 06:42:22.963317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 213/451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:22 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:23.557119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:23.558141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:23.567857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.568666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:23.570308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.571203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:23.735382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:23.736195 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:23.744635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.745397 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:23.749915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:23.754029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.755038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:23.761646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7c6128cd-1d89-4e76-ac5f-03c2f846e869 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.210640 May 11 06:42:23.777969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 239/452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:23 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:23.806776 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:23.807431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:23.813588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.814260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:23.815192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:23.815814 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:24.171047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.178262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9079666c-f645-4b0a-a92e-4a60fc4be825 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.449488 May 11 06:42:24.178940 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 214/453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:23 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:24.182311 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.183417 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:24.184022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:24.189618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:24.190066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:24.190385 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.190827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:24.191282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:24.191919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.193067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e65d8bb7-d43e-49f0-bcc0-6d238e65de25 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1722 microversion: 2.20 time: 0.394961 May 11 06:42:24.193621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 240/454] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:23 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:24.319731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.328079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eb985a69-6644-4fe7-8072-ada62c95cca8 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.148016 May 11 06:42:24.328729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 215/455] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:24 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:24.784904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:24.785510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:24.792026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:24.792476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:24.793232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:24.793660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:24.924901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:24.932226 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3da515d0-abdc-4e8a-bb34-55fa307f87dc tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.151039 May 11 06:42:24.932721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 241/456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:24 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:25.194873 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:25.195426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:25.202403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.202867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.203647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.204075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.213325 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:25.213934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:25.221880 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.222328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.223439 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.223585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.398768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:25.406824 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bd5425ac-f915-494f-a3ff-dc7ad2deced8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.215633 May 11 06:42:25.407581 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 216/457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:25 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:25.412808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:25.412937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:25.413401 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:25.419719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.420174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.420945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.421225 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:25.421386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.422848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:25.424119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5d713b6d-cc14-4902-bcd8-f8fb1c3cfed6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1722 microversion: 2.20 time: 0.215911 May 11 06:42:25.424674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 242/458] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:25 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:25.561366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:25.568587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5b97bf6b-a7a0-4677-8088-974da3dfc99a tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.159694 May 11 06:42:25.569148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 217/459] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:25 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:25.850101 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-05b23f87-dc5c-40b0-8f7c-b01c8aeeaed4 req-2342efca-da28-47ce-8bf2-71d701cd41fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f9778e-fe70-41f8-b12c-d55c6aa0ade9", "name": "network-vif-plugged", "status": "completed", "tag": "878b5dad-3ac4-42a4-af88-930587b53519"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:25.869744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-05b23f87-dc5c-40b0-8f7c-b01c8aeeaed4 req-2342efca-da28-47ce-8bf2-71d701cd41fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.870301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-05b23f87-dc5c-40b0-8f7c-b01c8aeeaed4 req-2342efca-da28-47ce-8bf2-71d701cd41fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.883657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-05b23f87-dc5c-40b0-8f7c-b01c8aeeaed4 req-2342efca-da28-47ce-8bf2-71d701cd41fd service nova] Creating event network-vif-plugged:878b5dad-3ac4-42a4-af88-930587b53519 for instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 on hv-cinder-80475 May 11 06:42:25.890898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-05b23f87-dc5c-40b0-8f7c-b01c8aeeaed4 req-2342efca-da28-47ce-8bf2-71d701cd41fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044642 May 11 06:42:25.891801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 243/460] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:25.949685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:25.951339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:25.957951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.958682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:25.959733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:25.960399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.148736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.158532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c575e2ef-b573-4f9e-b5e4-47b0236750df tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.212820 May 11 06:42:26.159829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 218/461] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:25 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:26.404166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-92d2dbb6-67da-4bda-8e2d-ce936273c68f req-5473a6b3-d37d-4bdf-8167-49732f74a1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:26.414531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-92d2dbb6-67da-4bda-8e2d-ce936273c68f req-5473a6b3-d37d-4bdf-8167-49732f74a1de service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.417835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-92d2dbb6-67da-4bda-8e2d-ce936273c68f req-5473a6b3-d37d-4bdf-8167-49732f74a1de service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.423951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:26.424451 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:26.442851 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.448998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.450238 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.451668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.455197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-92d2dbb6-67da-4bda-8e2d-ce936273c68f req-5473a6b3-d37d-4bdf-8167-49732f74a1de service nova] Creating event network-changed:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:42:26.467927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-92d2dbb6-67da-4bda-8e2d-ce936273c68f req-5473a6b3-d37d-4bdf-8167-49732f74a1de service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068180 May 11 06:42:26.469625 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 244/462] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:26.476036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:26.476948 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:26.486550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.487009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.487917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.488556 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.680645 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.683864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.688957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b7b694c3-a5a5-41ab-9909-54d6da1624ec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.268831 May 11 06:42:26.689648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 219/463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:26 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:26.691587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.693428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.694298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:26.694862 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2fd6dbbf-cd8f-42b8-96bb-1af8851c2293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1665 microversion: 2.20 time: 0.223081 May 11 06:42:26.694967 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:26.695455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 245/464] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:26 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1665 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:26.701280 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.701732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.702509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.702938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.713167 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d29bba3-1d43-408e-9231-7a8858aa206c"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:26.714473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:26.720883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.721326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.722087 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:26.722517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:26.840158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:26.847838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-57668dbf-ce94-4e60-9cce-2c7a9594d045 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.157190 May 11 06:42:26.848407 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 220/465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:26 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:27.000807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d8f89f39-9201-4931-bea4-daedc95496a8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291516 May 11 06:42:27.001604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 246/466] 10.222.0.64 () {62 vars in 1363 bytes} [Wed May 11 06:42:26 2022] POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:42:27.117988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:27.118552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:27.124434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.124900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.125694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.126130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.175482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:27.176088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:27.182030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.182453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.183203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.183654 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.217514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-af304492-0686-4e7f-9bff-d71dd2ce608b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/action" status: 202 len: 0 microversion: 2.20 time: 0.103341 May 11 06:42:27.221210 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 221/467] 10.222.0.64 () {62 vars in 1318 bytes} [Wed May 11 06:42:27 2022] POST /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:42:27.225810 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:27.226434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:27.233003 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.233454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.234231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.234668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.371062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:27.379711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d2cdb473-b574-4174-b32a-77ee1fa9d7ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.207963 May 11 06:42:27.389888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 247/468] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:27 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:27.405420 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:27.414623 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:27.416162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:27.417308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ff8ee1b8-12c2-4996-9856-08c950dacad6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1751 microversion: 2.20 time: 0.195213 May 11 06:42:27.417860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 222/469] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:27 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:27.706327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:27.708030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:27.713869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.714559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.715064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.715702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.868181 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:27.868925 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:27.875712 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.876242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.877097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.877921 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.888000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:27.895454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6f8f2a6f-58c4-4951-b3b8-954826b6f494 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.193409 May 11 06:42:27.896023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 248/470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:27 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:27.942176 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac5bc3a-4844-477e-a612-c18b8f0b9723", "name": "network-vif-plugged", "status": "completed", "tag": "cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e"}, {"server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "name": "network-vif-unplugged", "status": "completed", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:27.952538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:27.953141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:27.972264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] Creating event network-vif-plugged:cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e for instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 on hv-cinder-80475 May 11 06:42:27.972788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.compute.server_external_events [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] Unable to find a host for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec. Dropping event network-vif-unplugged {{(pid=128924) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 06:42:27.986331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-85ab36a9-4f84-4fd0-b2f8-c3473d3aa72f req-06b39f9a-7ca8-46e0-9dde-cddeb7938fa5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.047594 May 11 06:42:27.987065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 249/471] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 06:42:28.009777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:28.017364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-75e3419c-3bd3-4b18-ada0-622721751f9b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.154013 May 11 06:42:28.017930 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 223/472] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:27 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:28.397329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:28.398033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:28.404383 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.404829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:28.405616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.406043 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:28.436555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:28.437164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:28.443126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.443615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:28.444383 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.444819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:28.593579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:28.608673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-364c3310-68e4-4a72-9684-3498d96a836d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1366 microversion: 2.1 time: 0.208012 May 11 06:42:28.608673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 250/473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:28 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:28.621720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:28.630451 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:28.631977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:28.633114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4a59c9a6-814f-4f3c-9086-25f1ff8b4b8e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1751 microversion: 2.20 time: 0.201066 May 11 06:42:28.633669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 224/474] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:28 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:28.912303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:28.912906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:28.918950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.919437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:28.920202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:28.920635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.034068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:29.034886 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:29.041415 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.041868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.042638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.043076 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.053251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.061217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aa9d2ba6-3242-48f7-8247-6dfb2e6cfda6 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.152697 May 11 06:42:29.061780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 251/475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:28 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:29.168739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.176430 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d790e06f-f8f5-44f0-a5f1-ad2c54e89046 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.146294 May 11 06:42:29.176997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 225/476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:29 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:29.617825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:29.618436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:29.625530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.626568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.628529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.629162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.654300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:29.654635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:29.661525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.662321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.663290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.663840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.887066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.890316 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.899121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.899543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1659c3b8-7db6-433b-9c89-7b207efc4e27 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1557 microversion: 2.1 time: 0.285278 May 11 06:42:29.900799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:29.900997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 252/477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:29 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1557 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:29.901804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a88395b9-9579-4a9a-9ea7-0c3d8d0d6bed tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1751 microversion: 2.20 time: 0.253197 May 11 06:42:29.902528 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 226/478] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:29 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:29.917531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:29.918085 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:29.924216 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.924858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:29.925702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:29.926212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.005504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8cd5c372-9cc5-47dc-8f11-ca4eb95bbe0f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092169 May 11 06:42:30.006112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 253/479] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:42:29 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:30.078699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:30.079495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:30.085991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.086651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.087458 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.087898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.197502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:30.198739 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:30.205219 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.208108 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.209244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.211413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.361909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:30.371360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a26da976-f310-4a97-a38f-01f62d9e739d tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.296764 May 11 06:42:30.372682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 227/480] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:30 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:30.492341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:30.500550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-19edb133-f531-4df0-b611-c050707bd71c tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.309237 May 11 06:42:30.501669 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 254/481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:30 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:30.922026 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:30.922805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:30.938617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.939834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:30.941037 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:30.943836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.197078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:31.205764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:31.207571 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:31.208729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b754ee9b-2323-4601-af6c-bf6f72d4f17e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1753 microversion: 2.20 time: 0.291981 May 11 06:42:31.209278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 228/482] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:30 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1753 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:31.389450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:31.390063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:31.396280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:31.396736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.397510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:31.397945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.520578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:31.521457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:31.529391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:31.530116 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.531006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:31.531538 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.673492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:31.680944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-01fa41e4-7daf-4325-b4c3-d02c4f27cc33 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.295912 May 11 06:42:31.681741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 255/483] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:31 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:31.686066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-d3a4d2d8-d6a1-40a3-8cd0-aafca5d80fdd req-3fa5aac5-a834-4a08-8ba9-ee848a6183e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f9778e-fe70-41f8-b12c-d55c6aa0ade9", "tag": "878b5dad-3ac4-42a4-af88-930587b53519"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:31.693847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d3a4d2d8-d6a1-40a3-8cd0-aafca5d80fdd req-3fa5aac5-a834-4a08-8ba9-ee848a6183e2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:31.694292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d3a4d2d8-d6a1-40a3-8cd0-aafca5d80fdd req-3fa5aac5-a834-4a08-8ba9-ee848a6183e2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:31.706590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-d3a4d2d8-d6a1-40a3-8cd0-aafca5d80fdd req-3fa5aac5-a834-4a08-8ba9-ee848a6183e2 service nova] Creating event network-changed:878b5dad-3ac4-42a4-af88-930587b53519 for instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 on hv-cinder-80475 May 11 06:42:31.709579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:31.711639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-d3a4d2d8-d6a1-40a3-8cd0-aafca5d80fdd req-3fa5aac5-a834-4a08-8ba9-ee848a6183e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028920 May 11 06:42:31.712406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 256/484] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:31.717859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3f6bd88f-f0b8-4dcb-b4bc-2ce68155717f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1318 microversion: 2.1 time: 0.203236 May 11 06:42:31.718778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 229/485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:31 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:32.228951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:32.229545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:32.236177 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.236617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.237380 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.237805 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.368296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:32.377385 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:32.378870 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:32.380068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-701243c3-24a6-4679-b9df-7509a80bd19f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.155637 May 11 06:42:32.380624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 257/486] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:32 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:32.696809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:32.697422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:32.704235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.705072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.706071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.706507 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.737541 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:32.739178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:32.755657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.756540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.757569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.758231 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.924623 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:32.933443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eaa67d30-d5df-483f-8112-5fa34e0feef9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.240416 May 11 06:42:32.945932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 230/487] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:32 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:42:32.958394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:32.960896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-330ae01c-551e-4880-948f-4f3197aceae0 req-fe1ef94f-e34a-467e-b97d-ef2eea535a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "name": "network-vif-plugged", "status": "completed", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:32.967140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f7635262-1910-43d4-b606-78b1af27b4e6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1508 microversion: 2.1 time: 0.235577 May 11 06:42:32.970607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-330ae01c-551e-4880-948f-4f3197aceae0 req-fe1ef94f-e34a-467e-b97d-ef2eea535a22 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:32.971129 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-330ae01c-551e-4880-948f-4f3197aceae0 req-fe1ef94f-e34a-467e-b97d-ef2eea535a22 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:32.979665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 258/488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:32 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:32.984124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-330ae01c-551e-4880-948f-4f3197aceae0 req-fe1ef94f-e34a-467e-b97d-ef2eea535a22 service nova] Creating event network-vif-plugged:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:42:32.989414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-330ae01c-551e-4880-948f-4f3197aceae0 req-fe1ef94f-e34a-467e-b97d-ef2eea535a22 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041782 May 11 06:42:32.990253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 231/489] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:33.399313 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:33.400072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:33.408833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:33.409501 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:33.410463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:33.411077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:33.543540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:33.551788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:33.553274 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:33.554415 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1efe09b5-8486-4948-8240-0ef5132460b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.159294 May 11 06:42:33.554971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 259/490] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:33 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:33.952765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:33.953512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:33.960580 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:33.961028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:33.961808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:33.962239 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:34.093408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:34.100719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d2a200f1-bb7c-49f5-99c7-2e9c1de1e799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1371 microversion: 2.1 time: 0.152925 May 11 06:42:34.101286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 232/491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:33 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:34.573328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:34.573939 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:34.580368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:34.580819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:34.581613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:34.582051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:34.714725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:34.723930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:34.725405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:34.726540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-38c941ad-9c1a-4166-a876-840a12957b2f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.157449 May 11 06:42:34.727076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 260/492] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:34 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:35.119549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:35.121322 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:35.129573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.130617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.131881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.132970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.280641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:35.288382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b010ad69-963a-4392-b148-11ba43efaed7 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1565 microversion: 2.1 time: 0.173773 May 11 06:42:35.289117 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 233/493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:42:35 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:42:35.306340 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:35.307091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:35.314637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.315845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.317100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.317962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.409345 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-42d1609f-ba7d-479b-a2fa-9fb833e3f7b5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106685 May 11 06:42:35.410044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 261/494] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:42:35 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:35.745844 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:35.746362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:35.754070 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.754070 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.754404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:35.754830 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:35.892804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:35.901252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:35.902764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:35.904003 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-51487740-92c4-44cf-ac33-f5b17d6f0293 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.162080 May 11 06:42:35.904687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 234/495] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:35 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:36.253080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:42:36.253760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:42:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:42:36.667016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-f52bbe2c-3fce-4d01-82c6-bb6a878dc9d8 req-d3972e02-5461-4768-93c6-3d97da54aa0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:36.675695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f52bbe2c-3fce-4d01-82c6-bb6a878dc9d8 req-d3972e02-5461-4768-93c6-3d97da54aa0e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:36.676272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f52bbe2c-3fce-4d01-82c6-bb6a878dc9d8 req-d3972e02-5461-4768-93c6-3d97da54aa0e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:36.688004 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-f52bbe2c-3fce-4d01-82c6-bb6a878dc9d8 req-d3972e02-5461-4768-93c6-3d97da54aa0e service nova] Creating event network-changed:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:42:36.693080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-f52bbe2c-3fce-4d01-82c6-bb6a878dc9d8 req-d3972e02-5461-4768-93c6-3d97da54aa0e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029683 May 11 06:42:36.693687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 262/496] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:36.925397 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:36.926387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:36.935219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:36.935695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:36.936467 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:36.936906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:37.106536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:37.124194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:37.125708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:37.127286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5af4d98b-74ab-4e27-b52c-b2bf06b34621 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.205720 May 11 06:42:37.128033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 235/497] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:36 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:38.146502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:38.147297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:38.154302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:38.154788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:38.155527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:38.155966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:38.298637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:38.308264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:38.309835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:38.311022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1d019db3-bed4-4142-bdfb-74f8f9dd3b29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.168816 May 11 06:42:38.311611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 263/498] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:38 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:39.329751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:39.330504 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:39.338269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:39.338860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:39.339679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:39.340114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:39.476027 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:39.484247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:39.485745 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:39.486902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b0c4f6f7-81f9-4e81-b34e-854c200ffe62 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.161908 May 11 06:42:39.487472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 236/499] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:39 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:40.506315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:40.506931 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:40.513318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:40.513759 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:40.514514 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:40.514937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:40.662129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:40.685700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:40.688064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:40.689372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4fd5b9b8-0ec7-4237-875b-688d3f2e231e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.187258 May 11 06:42:40.690088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 264/500] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:40 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:41.709029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:41.709622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:41.716578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:41.717028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:41.717828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:41.718260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:41.859232 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:41.868148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:41.869740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:41.870959 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-789f935d-2638-49a3-b1ac-c9c7767dfd0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.165929 May 11 06:42:41.871529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 237/501] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:41 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:42.890556 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:42.892268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:42.899239 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:42.900040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:42.900889 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:42.901742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:43.042055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:43.051013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:43.052561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:43.053716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-560e0f3b-6e83-4c3b-a470-595d8cd57c15 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.168260 May 11 06:42:43.054278 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 265/502] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:42 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:44.072825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:44.073678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:44.081091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:44.081646 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:44.082639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:44.083197 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:44.226731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:44.237944 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:44.239647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:44.240837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8d0ec34c-560a-4d71-858e-0442cad32601 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.171951 May 11 06:42:44.241674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 238/503] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:44 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:45.263933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:45.264548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:45.270566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:45.271004 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:45.271800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:45.272240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:45.408914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:45.417781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:45.419878 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:45.421042 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-259ed212-7206-4c2c-9aee-a58187d4f632 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.164163 May 11 06:42:45.421599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 266/504] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:45 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:46.440491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:46.441092 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:46.447134 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:46.447616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:46.448627 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:46.449057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:46.576071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:46.585306 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:46.586795 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:46.587977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-149b1e81-24e2-4b76-bfc8-e56c2920e237 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.151437 May 11 06:42:46.588526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 239/505] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:46 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:47.606012 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:47.606647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:47.614147 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:47.614531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:47.615307 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:47.615747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:47.743544 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:47.751701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:47.753214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:47.754358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b74b35ce-e35f-4435-a0ed-79ffc0575925 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.152269 May 11 06:42:47.754920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 267/506] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:47 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:48.772768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:48.773446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:48.779836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:48.780284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:48.781045 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:48.781505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:48.905152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:48.913368 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:48.914863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:48.916026 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-db6cde28-1f51-4f80-8451-ce9ce0b033b9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.147357 May 11 06:42:48.916577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 240/507] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:48 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:49.935469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:49.936102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:49.942027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:49.942472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:49.943228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:49.943683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:50.071464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:50.080462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:50.081935 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:50.083092 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-22365dd3-4852-46fa-92b1-4d5487e2d9e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.152146 May 11 06:42:50.083677 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 268/508] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:49 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:51.102111 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:51.102715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:51.109395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:51.109841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:51.110595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:51.111029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:51.238173 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:51.246268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:51.248307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:51.249444 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-38f3ed65-8ec0-47f3-90d1-e07711591e66 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.151286 May 11 06:42:51.249994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 241/509] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:51 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:52.267834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:52.268401 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:52.274249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:52.274693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:52.275482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:52.275903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:52.406465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:52.414630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:52.416135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:52.417281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9d9ce5b3-a6ac-48de-98d8-afb8a300b6e3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.153423 May 11 06:42:52.417840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 269/510] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:52 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:53.436168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:53.436756 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:53.450480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:53.450933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:53.451734 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:53.452178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:53.579744 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:53.595864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:53.597375 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:53.598524 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-40fb82de-b88e-47f9-a4ff-1f7bcc4fd087 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.166968 May 11 06:42:53.599084 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 242/511] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:53 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:54.463214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2336dcce-aeb0-4169-8555-73f751eb0ecb", "device": "/dev/sdb"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:54.464823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:54.471221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:54.471708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:54.472471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:54.472915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:54.619382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:54.620088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:54.626663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:54.627186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:54.628037 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:54.628484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:54.760370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:54.769514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:54.771333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:54.772672 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-086cc9ca-d905-4aed-a707-a4fbac2b8f43 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.157187 May 11 06:42:54.773235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 243/512] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:54 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:42:54.786174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-954cf15d-e897-4e0c-a6dd-8065f1988ace tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "POST /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326653 May 11 06:42:54.786757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 270/513] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:42:54 2022] POST /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:55.791627 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:55.792237 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:55.799136 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:55.799615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:55.800378 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:55.800819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:55.929806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:55.938074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:55.939607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:55.940755 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-47a8d6ed-7b3b-4182-86d4-09106af6e63e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.153132 May 11 06:42:55.941308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 244/514] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:55 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:56.962424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:56.963130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:56.970574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:56.971018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:56.971807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:56.972241 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:57.105684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:57.113918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:57.115434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:57.116583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-56a3ef79-7de3-4faa-9650-08fdc6427148 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.158826 May 11 06:42:57.117144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 271/515] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:56 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:58.134685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:58.135298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:58.141637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:58.142076 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:58.142831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:58.143254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:58.272923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:58.281575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:58.283072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:58.284247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-084b3243-0ed0-4a4f-a2d1-8460d710a336 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.153452 May 11 06:42:58.284797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 245/516] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:58 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:42:58.908727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-7cdd1d7b-0bd0-431b-9d31-4b1664216791 req-4b9a59cd-fce2-47e4-8f87-4c270d5430fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "name": "network-vif-plugged", "status": "completed", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:42:58.917438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7cdd1d7b-0bd0-431b-9d31-4b1664216791 req-4b9a59cd-fce2-47e4-8f87-4c270d5430fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:58.917591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7cdd1d7b-0bd0-431b-9d31-4b1664216791 req-4b9a59cd-fce2-47e4-8f87-4c270d5430fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:58.928546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-7cdd1d7b-0bd0-431b-9d31-4b1664216791 req-4b9a59cd-fce2-47e4-8f87-4c270d5430fd service nova] Creating event network-vif-plugged:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:42:58.933489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-7cdd1d7b-0bd0-431b-9d31-4b1664216791 req-4b9a59cd-fce2-47e4-8f87-4c270d5430fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028447 May 11 06:42:58.934671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 272/517] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:42:59.303399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:42:59.303947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:42:59.310727 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:59.311172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:59.312025 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:42:59.312456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:42:59.440164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:59.448678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:59.450167 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:42:59.451333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-921a5e57-459b-4369-9e34-8cdd720098a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.151987 May 11 06:42:59.451888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 246/518] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:42:59 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:43:00.470750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:00.471470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:00.477617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:00.478077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:00.478839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:00.479290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:00.609665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:00.618364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:00.619902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:00.621059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-870540a9-abd8-4ca6-954b-fd84b1c4c76a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.155054 May 11 06:43:00.622293 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 273/519] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:43:00 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:43:01.640563 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:01.641156 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:01.647399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:01.647818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:01.648563 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:01.648988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:01.816845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:01.826191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:01.827729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:01.828878 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-43b1a79b-6c63-458c-8058-3fc8df4dfc4d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1809 microversion: 2.20 time: 0.192853 May 11 06:43:01.829442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 247/520] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:43:01 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:43:02.847160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:02.847694 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:02.853934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:02.854375 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:02.855124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:02.856210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:02.981528 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:02.990330 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:02.991959 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:02.993139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-27306349-c1c0-49f1-950e-cd02e06993fa tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1796 microversion: 2.20 time: 0.149899 May 11 06:43:02.993689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 274/521] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:43:02 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1796 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:43:19.398573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:19.399049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:19.405704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:19.406152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:19.406915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:19.407371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:19.530084 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lazy-loading 'services' on Instance uuid 3ac5bc3a-4844-477e-a612-c18b8f0b9723 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:43:19.639951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5dee172f-234d-48f4-bdbf-c104c276a7fd tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723/os-volume_attachments/2336dcce-aeb0-4169-8555-73f751eb0ecb" status: 202 len: 0 microversion: 2.1 time: 0.245049 May 11 06:43:19.640473 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 248/522] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:43:19 2022] DELETE /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723/os-volume_attachments/2336dcce-aeb0-4169-8555-73f751eb0ecb => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:43:21.798940 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:21.799450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:21.805698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:21.806139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:21.806888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:21.807347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:21.831254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:43:21.906023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f6218b96-c1da-483b-a3c9-34ffa68d53a9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 204 len: 0 microversion: 2.1 time: 0.110145 May 11 06:43:21.907050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 275/523] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:43:21 2022] DELETE /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:43:21.918167 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:21.918865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:21.924945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:21.925387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:21.926146 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:21.926573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:22.057765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:22.065491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-047d9e4a-508d-45fb-b4d1-99530f95b8d5 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1514 microversion: 2.1 time: 0.154094 May 11 06:43:22.066053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 249/524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:21 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:43:23.083888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:23.084592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:23.091391 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:23.091843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:23.092599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:23.093027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:23.219497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:23.226934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f3a5f2fa-6f5d-4033-bcf4-d763ce8128ba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1514 microversion: 2.1 time: 0.147294 May 11 06:43:23.227534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 276/525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:23 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:24.243880 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:24.244484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:24.251195 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:24.251664 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:24.252413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:24.252840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:24.380739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:24.388515 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7baf93bf-e391-4d37-886e-327a792612df tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1514 microversion: 2.1 time: 0.148546 May 11 06:43:24.389080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 250/526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:24 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:43:25.199898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-17db41f1-5e23-4cdb-a27b-38cd9467e00b req-a3ab9c78-8af6-4f4b-b8b7-cfc66b67c762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac5bc3a-4844-477e-a612-c18b8f0b9723", "name": "network-vif-deleted", "tag": "cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:25.208543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-17db41f1-5e23-4cdb-a27b-38cd9467e00b req-a3ab9c78-8af6-4f4b-b8b7-cfc66b67c762 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:25.208988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-17db41f1-5e23-4cdb-a27b-38cd9467e00b req-a3ab9c78-8af6-4f4b-b8b7-cfc66b67c762 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:25.220199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-17db41f1-5e23-4cdb-a27b-38cd9467e00b req-a3ab9c78-8af6-4f4b-b8b7-cfc66b67c762 service nova] Creating event network-vif-deleted:cfb53607-7fbc-4f5a-a8f2-b1ed289c7b2e for instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 on hv-cinder-80475 May 11 06:43:25.224829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-17db41f1-5e23-4cdb-a27b-38cd9467e00b req-a3ab9c78-8af6-4f4b-b8b7-cfc66b67c762 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029029 May 11 06:43:25.225422 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 277/527] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:25.405658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:25.406261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:25.412817 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:25.413261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:25.414054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:25.414481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:25.445038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:25.445472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:25.445992 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lazy-loading 'fault' on Instance uuid 3ac5bc3a-4844-477e-a612-c18b8f0b9723 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:43:25.707865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:25.715899 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d945f4ff-81a1-4f96-aafa-9211eb7314f3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 200 len: 1308 microversion: 2.1 time: 0.314565 May 11 06:43:25.716454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 251/528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:25 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:26.734729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:26.735367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: 3ac5bc3a-4844-477e-a612-c18b8f0b9723] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:26.741455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:26.741891 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:26.742637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:26.743059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:26.755779 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] HTTP exception thrown: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Request method failure captured: May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 HTTP/1.1 May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1q-JTDxWmwKEzM99hx6lyKlHA-XUF2nfq6-o8e1eR1fc4NjSVfRpGqCMTB2EEIuyl0RBZGTSO99FABjfN8LIbqHNzm2nawKOrj4-lMQ94BGTRzdQ370UjL5gLAr-A_BurefcyGFei52OaJUWgvdDoPjdzPpf8OO7bHBlTAFKNuTxvM May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 05347ecf2f1e4379bfa0f96c9df28c9c May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:43:26.757351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 05347ecf2f1e4379bfa0f96c9df28c9c May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotTestJSON-1685477785-project May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 55f7b1ca4478415c9b526c4e4b9e3ca2 May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotTestJSON-1685477785-project May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. May 11 06:43:26.759209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '3ac5bc3a-4844-477e-a612-c18b8f0b9723'} May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:43:26.760347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. May 11 06:43:26.761825 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:26.763192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Returning 404 to user: Instance 3ac5bc3a-4844-477e-a612-c18b8f0b9723 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:43:26.763192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8aa3c3e4-d2d5-45fe-9bcf-35e5764fa58e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723" status: 404 len: 111 microversion: 2.1 time: 0.029823 May 11 06:43:26.763192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 278/529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:26 2022] GET /compute/v2.1/servers/3ac5bc3a-4844-477e-a612-c18b8f0b9723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:43:36.579160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1301282538", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "networks": [{"uuid": "755ee928-3089-4dea-bd5b-18623aa24349"}]}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:36.630290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] validate_networks() for [('755ee928-3089-4dea-bd5b-18623aa24349', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:43:36.960404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:43:36.960821 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:43:36.961314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:43:36.961719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:43:36.962123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:43:36.971226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:36.971715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:36.972492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:36.972926 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:36.988753 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Getting quotas for project 05347ecf2f1e4379bfa0f96c9df28c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:43:36.992508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Getting quotas for user 55f7b1ca4478415c9b526c4e4b9e3ca2 and project 05347ecf2f1e4379bfa0f96c9df28c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:43:37.003659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:43:37.005997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:43:37.050225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b184b350-15f9-4c57-a739-7b088b5fa8a0 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475343 May 11 06:43:37.050868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 252/530] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:43:37.061232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5bffd7d4-95ae-42b2-a9cf-d9b26be614af tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:37.061848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5bffd7d4-95ae-42b2-a9cf-d9b26be614af tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:37.115354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5bffd7d4-95ae-42b2-a9cf-d9b26be614af tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:37.122422 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5bffd7d4-95ae-42b2-a9cf-d9b26be614af tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1219 microversion: 2.1 time: 0.065549 May 11 06:43:37.122991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 279/531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:37 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:38.140620 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:38.141333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:38.147708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:38.148282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:38.149057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:38.149495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:38.242315 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:38.250428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7829bc94-f72a-4365-8cb1-8d4eede96bb6 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1279 microversion: 2.1 time: 0.114825 May 11 06:43:38.251001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 253/532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:38 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:39.244368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:39.244965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:39.252093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.252713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.253499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.254112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.268077 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:39.269740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:39.276112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.276991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.278544 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.279210 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.281234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bb28610f-0ceb-472e-be0e-96381cf0568d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/ips" status: 200 len: 151 microversion: 2.1 time: 0.040645 May 11 06:43:39.281823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 280/533] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:43:39 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:39.292599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b2c04b-6959-40a7-82a5-2dc9943fd297"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:39.294257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:39.300355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.300811 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.301591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.302341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.381923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/os-volume_attachments HTTP/1.1 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 74 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:43:39.383725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {"volumeAttachment": {"volumeId": "a8b2c04b-6959-40a7-82a5-2dc9943fd297"}} May 11 06:43:39.385257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'server_id': '10f9778e-fe70-41f8-b12c-d55c6aa0ade9', 'body': {'volumeAttachment': {'volumeId': 'a8b2c04b-6959-40a7-82a5-2dc9943fd297'}}} May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:39.386285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:39.388107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 400 to user: Invalid volume: volume a8b2c04b-6959-40a7-82a5-2dc9943fd297 is already attached to instances: fe36d742-5157-4f04-9f55-02dfafa7d39a {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c4a358c6-2e46-41e9-b8b7-ab37f52ab87e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096680 May 11 06:43:39.390151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 281/534] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:43:39 2022] POST /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:43:39.393867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:39.394361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:39.400904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.401370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.402145 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.402581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.432675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:43:39.498342 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:39.508382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b11770a7-edbc-4b23-a649-8fb354eba4bf tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.243850 May 11 06:43:39.510887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0920f8fb-f05d-4b4a-b389-72142dc50812 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 204 len: 0 microversion: 2.1 time: 0.120152 May 11 06:43:39.511763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 282/535] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:43:39 2022] DELETE /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:43:39.518476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 254/536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:39 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:43:39.528222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:39.528944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:39.535583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.536035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.536807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.537245 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.586256 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-b4cf7b0e-392c-425d-a63a-93e4f8669b07 req-66c1069c-57e8-4994-af61-27c7514669c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d4ab69-7025-4c29-9e86-88f48dec8d5b", "tag": "345508dc-7ee8-4f6f-968f-12fa627c66a9"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:39.594177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b4cf7b0e-392c-425d-a63a-93e4f8669b07 req-66c1069c-57e8-4994-af61-27c7514669c0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:39.594654 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b4cf7b0e-392c-425d-a63a-93e4f8669b07 req-66c1069c-57e8-4994-af61-27c7514669c0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:39.605191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-b4cf7b0e-392c-425d-a63a-93e4f8669b07 req-66c1069c-57e8-4994-af61-27c7514669c0 service nova] Creating event network-changed:345508dc-7ee8-4f6f-968f-12fa627c66a9 for instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b on hv-cinder-80475 May 11 06:43:39.610543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-b4cf7b0e-392c-425d-a63a-93e4f8669b07 req-66c1069c-57e8-4994-af61-27c7514669c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028013 May 11 06:43:39.611127 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 255/537] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:43:39.702384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:39.709669 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-84670222-7cda-4110-94da-90088a22e5e5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1682 microversion: 2.1 time: 0.187007 May 11 06:43:39.710239 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 283/538] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:39 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:40.526073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:40.526800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:40.532793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:40.533240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:40.534007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:40.534438 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:40.660736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:40.667870 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0406251e-693c-4082-8fca-0806099bbdba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.146451 May 11 06:43:40.668939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 256/539] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:40 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:40.727892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:40.728455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:40.735376 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:40.735818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:40.736569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:40.736998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:40.864455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:40.871760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a119ab3f-77f5-4ba4-8f74-3847d7a12267 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1682 microversion: 2.1 time: 0.147837 May 11 06:43:40.872314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 284/540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:40 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:41.686510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:41.687074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:41.693284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:41.693732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:41.694476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:41.694903 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:41.889063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:41.889670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:41.894053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:41.896659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:41.897200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:41.898051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:41.898557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:41.905095 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-62143e23-3bcf-4551-acd5-f8827b38aea7 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.222649 May 11 06:43:41.915595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 257/541] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:41 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:42.119384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:42.127007 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-333857fa-bf8d-4457-aa85-804457a86552 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1682 microversion: 2.1 time: 0.241856 May 11 06:43:42.127859 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 285/542] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:41 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:43:42.787019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-dcfc7e37-be0c-428a-93f0-3904ef9a5d7d req-a9a9a7fc-4217-4445-8699-0c8821795c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f9778e-fe70-41f8-b12c-d55c6aa0ade9", "name": "network-vif-deleted", "tag": "878b5dad-3ac4-42a4-af88-930587b53519"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:42.795525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-dcfc7e37-be0c-428a-93f0-3904ef9a5d7d req-a9a9a7fc-4217-4445-8699-0c8821795c15 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:42.796036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-dcfc7e37-be0c-428a-93f0-3904ef9a5d7d req-a9a9a7fc-4217-4445-8699-0c8821795c15 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:42.811099 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-dcfc7e37-be0c-428a-93f0-3904ef9a5d7d req-a9a9a7fc-4217-4445-8699-0c8821795c15 service nova] Creating event network-vif-deleted:878b5dad-3ac4-42a4-af88-930587b53519 for instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 on hv-cinder-80475 May 11 06:43:42.816282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-dcfc7e37-be0c-428a-93f0-3904ef9a5d7d req-a9a9a7fc-4217-4445-8699-0c8821795c15 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 May 11 06:43:42.817283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 258/543] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:42.922075 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:42.922664 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:42.929176 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:42.929624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:42.930383 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:42.930815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:43.062686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:43.070569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-04849905-8813-42c0-86b6-fe7a713fe602 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.152558 May 11 06:43:43.071431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 286/544] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:42 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:43.145278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:43.146061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:43.152512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:43.153808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:43.154613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:43.155045 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:43.218642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:43.226366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6d598883-560e-4bff-bd0a-dc860234cc5e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 200 len: 1614 microversion: 2.1 time: 0.085591 May 11 06:43:43.226946 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 259/545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:43 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:44.088333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:44.088903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:44.095298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.095764 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.096534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.096977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.244680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:44.249542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:44.250347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:44.254849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ae4bd4a0-c148-4790-9a5a-2a26d03ccaba tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.170315 May 11 06:43:44.255783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 287/546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:44 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:44.270147 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.270646 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.271720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.272338 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.287535 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 HTTP/1.1 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:43:44.289189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:43:44.290472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '10f9778e-fe70-41f8-b12c-d55c6aa0ade9'} May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:43:44.291192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:43:44.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:43:44.293842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:43:44.293842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bc5909c3-b25d-42d2-8fc2-31a4a87edd3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 404 len: 111 microversion: 2.1 time: 0.050463 May 11 06:43:44.294636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 260/547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:44 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:43:44.300490 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-95d84fa3-7f9a-49bd-9ed2-50feceadc6d8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '.version_select at 0x7fc5c8d32af0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:44.319325 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-95d84fa3-7f9a-49bd-9ed2-50feceadc6d8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642098924" status: 202 len: 0 microversion: 2.1 time: 0.023264 May 11 06:43:44.319885 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 288/548] 10.222.0.64 () {58 vars in 1220 bytes} [Wed May 11 06:43:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642098924 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:43:44.341245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "263816dd-5e43-441e-93e6-1471d3b82ade"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:44.343042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:44.350880 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.351364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.352488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:44.352948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:44.658038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-05852c97-3f6b-4eea-b6d1-2f9dc7e978a9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322491 May 11 06:43:44.659603 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 261/549] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:43:44 2022] POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:45.071372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:45.071966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:45.080731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.081180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.082358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.082798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.220340 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lazy-loading 'services' on Instance uuid fe36d742-5157-4f04-9f55-02dfafa7d39a {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:43:45.277864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:45.278714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:45.286981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.287700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.288609 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.289138 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.342242 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d14ea303-55d5-4061-8699-a2e19df105ba tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments/a8b2c04b-6959-40a7-82a5-2dc9943fd297" status: 202 len: 0 microversion: 2.1 time: 0.276307 May 11 06:43:45.343052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 289/550] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:43:45 2022] DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments/a8b2c04b-6959-40a7-82a5-2dc9943fd297 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:43:45.352415 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:45.353756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:45.368817 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.369522 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.370298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:45.370731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:45.406627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4934d7f4-e863-4a57-9c66-e99955457b90 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058171 May 11 06:43:45.407676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 290/551] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:45 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:43:45.436905 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:45.444965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-139f715e-0e29-4aeb-9ef4-243465c5879f tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.172553 May 11 06:43:45.445885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 262/552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:45 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:46.417994 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:46.419474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:46.425859 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:46.426319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:46.427070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:46.427533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:46.456334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8dc30f6f-5ec3-4eca-853f-f6284a90dc80 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 May 11 06:43:46.456936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 291/553] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:46 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:46.461862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:46.462487 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:46.468801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:46.469254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:46.470016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:46.470454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:46.594069 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:46.601325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9628312d-41ff-41a1-85d3-86677201ff64 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.143253 May 11 06:43:46.601895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 263/554] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:46 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:47.081271 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-d1aa3d98-d992-4d38-b533-31f2b59186e0 req-b5ef874e-96fc-45ee-97af-1724e82f5cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d4ab69-7025-4c29-9e86-88f48dec8d5b", "name": "network-vif-plugged", "status": "completed", "tag": "345508dc-7ee8-4f6f-968f-12fa627c66a9"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:47.089463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d1aa3d98-d992-4d38-b533-31f2b59186e0 req-b5ef874e-96fc-45ee-97af-1724e82f5cb8 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:47.089904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d1aa3d98-d992-4d38-b533-31f2b59186e0 req-b5ef874e-96fc-45ee-97af-1724e82f5cb8 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:47.101527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-d1aa3d98-d992-4d38-b533-31f2b59186e0 req-b5ef874e-96fc-45ee-97af-1724e82f5cb8 service nova] Creating event network-vif-plugged:345508dc-7ee8-4f6f-968f-12fa627c66a9 for instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b on hv-cinder-80475 May 11 06:43:47.106182 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-d1aa3d98-d992-4d38-b533-31f2b59186e0 req-b5ef874e-96fc-45ee-97af-1724e82f5cb8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028515 May 11 06:43:47.106772 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 292/555] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:47.467901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:47.468897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:47.475517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:47.475972 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:47.476758 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:47.477197 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:47.509670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d55532c1-882c-4ca4-a023-bf1f7dca268d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 May 11 06:43:47.510247 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 264/556] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:47 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:47.620035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:47.620733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:47.628155 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:47.628613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:47.629389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:47.629820 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:47.760047 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:47.767203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-80a16892-1a35-41a6-96bb-04e649892439 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.151916 May 11 06:43:47.767801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 293/557] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:47 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:48.521248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:48.522173 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:48.528611 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:48.529065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:48.529832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:48.530274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:48.560336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3f402433-da7a-4ddd-80db-6ea38c2a911b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 May 11 06:43:48.560887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 265/558] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:48 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:48.783674 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:48.784276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:48.790566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:48.791016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:48.791812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:48.792243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:48.921871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:48.929118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-69a134bc-5142-4e02-a88e-101bcd312cbb tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1319 microversion: 2.1 time: 0.149223 May 11 06:43:48.929665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 294/559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:48 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:49.571592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:49.572539 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:49.579086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:49.579569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:49.580350 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:49.580775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:49.610199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-332a00e1-695d-49cd-bd5c-1e7b5a71a881 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 May 11 06:43:49.610918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 266/560] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:49 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:49.945616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:49.946218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:49.952670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:49.953109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:49.953864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:49.954297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:50.080087 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:50.087202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-324b08d0-ad09-47b8-8f51-97ac891e752b tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1509 microversion: 2.1 time: 0.145369 May 11 06:43:50.087796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 295/561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:49 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:50.104025 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e1e03f-24ee-42ed-b15f-4bbe91f95748", "device": "/dev/sdb"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:50.105621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:50.111419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:50.111871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:50.112627 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:50.113063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:50.355371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-60c520f3-e52f-4e06-adbe-3bdcd2c88770 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "POST /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255014 May 11 06:43:50.356153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 267/562] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:43:50 2022] POST /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:50.622536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:50.623483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:50.629465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:50.629907 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:50.630688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:50.631113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:50.659329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-55469f8d-5d99-44b6-afc8-a4ff10a68001 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 May 11 06:43:50.660025 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 296/563] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:50 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:51.671617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:51.672736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:51.679287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:51.679737 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:51.680495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:51.680923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:51.710677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-31e7da66-9a94-4ea1-a20b-7563977bfb07 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 May 11 06:43:51.711341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 268/564] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:51 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:52.132518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:52.133447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:52.140187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.141416 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.142245 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.142690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.165073 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'flavor' on Instance uuid 1c304119-9fe2-4635-ac4f-081c9c1ab062 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:43:52.282117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4931fa96-7bb3-4cee-a98e-6a1ef1eec8e2 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/action" status: 200 len: 32 microversion: 2.1 time: 0.153388 May 11 06:43:52.282630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 297/565] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:43:52 2022] POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:43:52.291459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:52.292075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:52.298503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.298953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.299746 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.300185 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.437408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:52.445484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-75bf77a1-9d40-4dc5-b682-8768dabaa781 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.157742 May 11 06:43:52.446066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 269/566] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:52 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:52.723035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:52.724507 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:52.732659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.733354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.734128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:52.734561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:52.763772 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bfef1cd4-ade6-43f1-a47e-9077213f1f87 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 May 11 06:43:52.764574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 298/567] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:52 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:43:53.462381 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:53.463047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:53.470172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.470618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.471395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.471825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.599104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:53.606843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7660edd0-44aa-4fde-9a63-7de4c01060df tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.148280 May 11 06:43:53.607439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 270/568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:53 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:53.773978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:53.774499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:53.774997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:53.775971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:53.782142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.782591 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.783370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.783502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.783804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.783924 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.784594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.785036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.812661 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-715eaa65-001e-435b-9e4e-556ced85f1f0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments/2d29bba3-1d43-408e-9231-7a8858aa206c" status: 200 len: 194 microversion: 2.20 time: 0.042752 May 11 06:43:53.813184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cf2cf076-3f21-4ea8-acb0-192e0f96d2a1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041993 May 11 06:43:53.813321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 299/569] 10.222.0.64 () {60 vars in 1453 bytes} [Wed May 11 06:43:53 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments/2d29bba3-1d43-408e-9231-7a8858aa206c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:43:53.813997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 271/570] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:43:53 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:43:53.870224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:53.870725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:53.875483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:53.875967 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:53.876746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.877197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.877945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.878374 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.881901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.882353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.883115 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:53.883582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:53.903978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:43:53.962145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'services' on Instance uuid 86b8d3ad-c5ac-43be-9752-33e7891c2aec {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:43:53.989033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5eb65a45-1be1-4b51-a147-5c727f84d160 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 204 len: 0 microversion: 2.1 time: 0.122133 May 11 06:43:53.989701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 300/571] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:43:53 2022] DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:43:54.000015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:54.000717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:54.006369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.006821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.007634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.008071 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.039933 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-761d6733-43b3-4003-b5dd-c2eb226c44d3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments/2d29bba3-1d43-408e-9231-7a8858aa206c" status: 202 len: 0 microversion: 2.20 time: 0.168197 May 11 06:43:54.040532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 272/572] 10.222.0.64 () {60 vars in 1456 bytes} [Wed May 11 06:43:53 2022] DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments/2d29bba3-1d43-408e-9231-7a8858aa206c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 06:43:54.050047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:54.051117 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:54.057321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.057767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.058540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.059537 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.087764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7c4a26d9-3ca3-4a97-80fe-70d8ef929206 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041982 May 11 06:43:54.088330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 273/573] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:54 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:43:54.137978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:54.145426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c2c31dba-9333-40d2-a671-005515096cde tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1682 microversion: 2.1 time: 0.151457 May 11 06:43:54.145991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 301/574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:53 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:43:54.623550 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:54.624206 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:54.631000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.631896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.633267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:54.633717 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:54.763232 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:54.770910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-57c8241a-1ad2-4ca9-9d74-b37501809323 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.151708 May 11 06:43:54.771514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 274/575] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:54 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:55.099665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:55.100531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:55.107139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.107614 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.108374 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.108809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.136567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f1cd1e18-5a6b-49cd-ab83-1c4519e01bb4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 May 11 06:43:55.137178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 302/576] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:55 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:43:55.161812 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:55.162447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:55.169426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.169878 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.170639 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.171077 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.294706 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:55.301847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bdd24027-2de2-418f-b240-02ab47db1ff5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1682 microversion: 2.1 time: 0.143885 May 11 06:43:55.302409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 275/577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:55 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:55.788553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:55.789087 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:55.795628 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.796081 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.796833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:55.797263 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:55.924304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:55.932124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6a25e684-bdeb-40d7-badf-00bbf7f31da3 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.147406 May 11 06:43:55.932833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 303/578] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:55 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:56.147760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:56.148740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:56.155355 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.155809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:56.156572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.157009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:56.186330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2fce60ce-338b-4570-bcbe-a67f727f3203 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042625 May 11 06:43:56.186890 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 276/579] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:56 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:43:56.320446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:56.321095 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:56.327738 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.328190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:56.328950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.329388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:56.454517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:56.461867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8350933b-ed1d-4a7a-86dc-832daa88175d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1682 microversion: 2.1 time: 0.145293 May 11 06:43:56.462440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 304/580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:56 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:56.950688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:56.951628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:56.959621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.960078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:56.960829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:56.963250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.169583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:57.178310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f9a1babf-895b-4b8e-a8fc-c8d14a0ec51f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.232013 May 11 06:43:57.179315 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 277/581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:56 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:57.197206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:57.198469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:57.204711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:57.205166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.205937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:57.206376 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.237029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-93214bad-a23e-413e-a9e7-0075890be3e6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043754 May 11 06:43:57.237863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 305/582] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:57 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:43:57.466475 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-01d56f58-fb39-415d-85ae-87a12a4dc8cd req-a13d0c67-8b1c-4216-beab-27bfd309a1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe36d742-5157-4f04-9f55-02dfafa7d39a", "name": "network-vif-deleted", "tag": "c372b82a-d12b-49fe-954d-646c72f56cf5"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:57.475345 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-01d56f58-fb39-415d-85ae-87a12a4dc8cd req-a13d0c67-8b1c-4216-beab-27bfd309a1d6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:57.475793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-01d56f58-fb39-415d-85ae-87a12a4dc8cd req-a13d0c67-8b1c-4216-beab-27bfd309a1d6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.479111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:57.479961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:57.493025 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-01d56f58-fb39-415d-85ae-87a12a4dc8cd req-a13d0c67-8b1c-4216-beab-27bfd309a1d6 service nova] Creating event network-vif-deleted:c372b82a-d12b-49fe-954d-646c72f56cf5 for instance fe36d742-5157-4f04-9f55-02dfafa7d39a on hv-cinder-80475 May 11 06:43:57.502587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-01d56f58-fb39-415d-85ae-87a12a4dc8cd req-a13d0c67-8b1c-4216-beab-27bfd309a1d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039567 May 11 06:43:57.503679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 278/583] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:57.504192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:57.504801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.505920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:57.506664 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:57.580635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:57.590678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-84d225d8-2a4f-4a06-a227-287eb93596dd tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 200 len: 1326 microversion: 2.1 time: 0.112348 May 11 06:43:57.591634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 306/584] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:57 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:58.198276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:58.199053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:58.205940 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.206385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.207153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.207611 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.248612 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:58.249843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:58.256236 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.256695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.257548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.257992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.289428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3d3ce6cc-12b2-4091-951b-0b4ce75a138d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 May 11 06:43:58.290023 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 307/585] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:58 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:43:58.347126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:58.355060 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7a3351b3-300e-4633-b8f0-29eade644904 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.162394 May 11 06:43:58.356225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 279/586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:58 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:43:58.608355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:58.609442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:58.615992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.616443 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.617208 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:58.617643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:58.632273 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a HTTP/1.1 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:43:58.633972 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:43:58.635482 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'fe36d742-5157-4f04-9f55-02dfafa7d39a'} May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:43:58.636327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:43:58.637750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:43:58.639168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:43:58.639168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-abdaac5c-261d-41fd-9b76-6fa77194c3a8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 404 len: 111 microversion: 2.1 time: 0.032286 May 11 06:43:58.639168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 308/587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:58 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:43:58.644083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-58958327-1747-40e3-8b9e-79101870e580 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '.version_select at 0x7fc5c849c9d0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:58.665370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-58958327-1747-40e3-8b9e-79101870e580 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651770994" status: 202 len: 0 microversion: 2.1 time: 0.025009 May 11 06:43:58.665920 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 280/588] 10.222.0.64 () {58 vars in 1217 bytes} [Wed May 11 06:43:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651770994 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:43:59.282318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa097255-eb00-483a-9e9a-b34687319123 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: .version_select at 0x7fc5c8cb99d0>, body: {"keypair": {"name": "tempest-keypair-604362191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCqvecyl99gFwTchCx7lELoNS7PHTdZQsVymNerNZcY0JGCOsKFEsR11JYLFUJn2czYB2RJMSYqv1ygwq8AoT4oWI25TgbXtcJZRrnQtoIPWGNmq6MP/EvhMpx9zw5uyQ=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:43:59.295788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-fa097255-eb00-483a-9e9a-b34687319123 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:43:59.299569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-fa097255-eb00-483a-9e9a-b34687319123 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:43:59.302262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:59.303742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:59.310031 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:59.310484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:59.312166 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:59.312611 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:59.321438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa097255-eb00-483a-9e9a-b34687319123 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043485 May 11 06:43:59.322029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 309/589] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:43:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:43:59.346111 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0412e5da-587a-4c7a-b970-f0418f0a9855 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048394 May 11 06:43:59.346697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 281/590] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:43:59 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:43:59.373968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:43:59.374558 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:43:59.380404 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:59.380847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:59.381594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:43:59.382024 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:43:59.558791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:43:59.567506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-52e1da39-eb5f-4dab-a8f2-f36cd16c6738 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.198139 May 11 06:43:59.568097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 310/591] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:43:59 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:00.358880 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:00.359999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:00.366085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:00.366533 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:00.367325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:00.367766 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:00.397038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3a16f87f-1ad4-4b3c-b666-0e35261fa7a5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042809 May 11 06:44:00.397605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 282/592] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:44:00 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:44:00.586751 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:00.587477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:00.594714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:00.595162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:00.595962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:00.596408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:00.703771 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-544083498", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e699df-3755-47eb-b019-c5436429fdb7"}], "security_groups": [{"name": "tempest-securitygroup--1357353393"}], "key_name": "tempest-keypair-604362191", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:00.730362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:00.739019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0cb4046-bd93-4c54-b577-ff1bf247ac80 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.156834 May 11 06:44:00.739598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 311/593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:00 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:00.799918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] validate_networks() for [('61e699df-3755-47eb-b019-c5436429fdb7', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:44:01.153977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:44:01.154400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:44:01.154898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:44:01.155328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:44:01.155742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:44:01.164428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.164879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.165675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.166113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.182334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:44:01.186913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:44:01.197955 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:44:01.201137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:44:01.245107 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2eaf984c-ca2f-4fc3-a89b-646fba12485c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.545591 May 11 06:44:01.245742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 283/594] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:44:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:44:01.256632 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d186633c-af92-4bf3-aa5f-95bf45e8dd99 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:01.257240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d186633c-af92-4bf3-aa5f-95bf45e8dd99 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:01.310031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d186633c-af92-4bf3-aa5f-95bf45e8dd99 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:01.316458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d186633c-af92-4bf3-aa5f-95bf45e8dd99 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1240 microversion: 2.1 time: 0.064127 May 11 06:44:01.317021 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 312/595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:01 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:01.409936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:01.410895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:01.416808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.417255 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.418009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.418440 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.453733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-89114467-7764-41ee-bbfe-ee77eb22461c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048129 May 11 06:44:01.454315 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 284/596] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:44:01 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:44:01.756780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:01.757390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:01.764462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.764914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.765680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:01.766118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:01.889356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:01.897052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-395b1df2-4c13-41aa-a564-69e786de3e9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.144162 May 11 06:44:01.897623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 313/597] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:01 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:02.333743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:02.334350 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:02.340267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.340716 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:02.341481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.341915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:02.403635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:02.410919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f7816b26-509d-417e-ae08-2c55850ade59 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1244 microversion: 2.1 time: 0.080979 May 11 06:44:02.411516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 285/598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:02 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:02.466114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:02.467154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:02.473083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.473531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:02.474284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.474716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:02.502736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cd890ee0-01c9-4b5a-a932-4d8ad281d477 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041128 May 11 06:44:02.503296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 314/599] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:44:02 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:44:02.913548 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:02.914172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:02.921540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.921983 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:02.922739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:02.923165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:03.053694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:03.061482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-58841d76-6e50-4c76-9c38-2e587b4a5ebf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.151775 May 11 06:44:03.062053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 286/600] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:02 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:03.433323 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:03.434718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:03.442361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:03.442361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:03.443167 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:03.443697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:03.514245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:03.515176 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:03.521489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:03.521936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:03.522699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:03.523344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:03.525073 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:03.535171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9b6a7172-ebf9-4039-ac1e-172e1ed148aa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1292 microversion: 2.1 time: 0.110784 May 11 06:44:03.535929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 315/601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:03 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1292 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:03.562156 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9dfcc36c-8e56-4269-830b-6f1b6a1eb434 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051983 May 11 06:44:03.562710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 287/602] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:44:03 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:44:04.080295 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:04.083868 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:04.090639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.090639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.091583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.092082 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.305066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:04.313203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-27ff3cb6-7649-4f3a-a8c9-6f1b4de5f060 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.238383 May 11 06:44:04.322644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 316/603] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:04 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:04.551811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:04.552419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:04.558899 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.559948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.560722 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.561160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.574132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:04.575383 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:04.583547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.584236 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.585188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.585712 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.618969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9a66fa0b-d83a-4aa0-875d-202f5743d84c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049064 May 11 06:44:04.619916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 317/604] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:44:04 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:04.684291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:04.685529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:04.691480 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.691936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.692704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.693142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.718539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:44:04.799235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-49cf277d-36ae-489a-9d0a-ecb135ef2818 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 204 len: 0 microversion: 2.20 time: 0.118460 May 11 06:44:04.800036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 318/605] 10.222.0.64 () {60 vars in 1279 bytes} [Wed May 11 06:44:04 2022] DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:44:04.807052 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:04.808425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:04.809159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:04.816005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-882b14f6-95a2-432e-93f7-a15e01a5b2da tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1298 microversion: 2.1 time: 0.267911 May 11 06:44:04.825614 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.825798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 288/606] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:04 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:04.825901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.825901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:04.825901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:04.963929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:04.973354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:04.975027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:04.976506 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-15380ad7-7597-46db-b9d7-0fe3ed771486 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.172215 May 11 06:44:04.977151 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 319/607] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:04 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:44:05.330708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:05.331235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:05.337241 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:05.337687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:05.338451 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:05.338880 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:05.472533 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:05.480258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e4fe0aaa-181e-4c18-ab33-02006720c05c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.153497 May 11 06:44:05.480823 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 289/608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:05 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:05.833146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:05.833786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:05.840186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:05.841221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:05.841975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:05.842408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:05.965062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:05.973128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d4d10aa5-4323-446e-8516-2ff8cf8583e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.143793 May 11 06:44:05.973697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 320/609] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:05 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:05.995477 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:05.996073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:06.002406 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:06.002853 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:06.003633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:06.004061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:06.131724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:06.139922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:06.141409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:06.142540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2f89dee5-e240-4d6e-84b7-213759e22c45 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.150954 May 11 06:44:06.143102 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 290/610] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:05 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:06.498393 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:06.498993 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:06.504917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:06.505364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:06.506121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:06.506554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:06.630590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:06.638822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2d71885c-6b3b-46a2-a978-45cc079e8d3f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.144757 May 11 06:44:06.639626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 321/611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:06 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:06.991874 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:06.992396 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:06.999290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:06.999832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.000480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:07.000911 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.133877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:07.141615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7b0ff95b-5ea3-450c-826c-8c28494dd82a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.153686 May 11 06:44:07.142171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 291/612] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:06 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:07.161209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:07.161819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:07.168053 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:07.168533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.169313 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:07.169736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.295819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:07.304014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:07.305526 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:07.306687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-09d78319-5264-4adf-802a-6ee11a26a1d2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.149299 May 11 06:44:07.307255 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 322/613] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:07 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:07.654919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:07.655697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:07.661668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:07.662134 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.662897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:07.663500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:07.793457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:07.801695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-af50549c-6df9-441b-b1f9-2bf53417c8c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.150678 May 11 06:44:07.802269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 292/614] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:07 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:08.118067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-e10816e7-a1a1-4255-a69c-5b05a3d32bfc req-a7147c97-8dc7-4df2-9789-050019a5b48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d780cb-2ea7-4645-937d-03eef82ae3c4", "tag": "46f06357-bb6c-4461-a2f7-c4a89a2e46fe"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:08.126899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e10816e7-a1a1-4255-a69c-5b05a3d32bfc req-a7147c97-8dc7-4df2-9789-050019a5b48e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.127395 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e10816e7-a1a1-4255-a69c-5b05a3d32bfc req-a7147c97-8dc7-4df2-9789-050019a5b48e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.139477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-e10816e7-a1a1-4255-a69c-5b05a3d32bfc req-a7147c97-8dc7-4df2-9789-050019a5b48e service nova] Creating event network-changed:46f06357-bb6c-4461-a2f7-c4a89a2e46fe for instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 on hv-cinder-80475 May 11 06:44:08.145462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-e10816e7-a1a1-4255-a69c-5b05a3d32bfc req-a7147c97-8dc7-4df2-9789-050019a5b48e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031062 May 11 06:44:08.146076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 323/615] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:08.157849 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:08.158469 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:08.165908 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.166363 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.167145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.167613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.303762 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:08.311137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-78c37891-e2e6-4b62-9b4f-c8d67f2b365e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.157174 May 11 06:44:08.311728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 293/616] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:08 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:08.327553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:08.328250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:08.335780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.336232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.337000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.337441 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.517344 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:08.525078 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:08.526539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:08.528284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a2fa07f1-cce8-42ae-823a-e2812faa86b3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.205994 May 11 06:44:08.528842 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 324/617] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:08 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:08.818133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:08.818737 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:08.825261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.825707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.826460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:08.826894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:08.953590 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:08.961218 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8da0683e-e38f-4cb0-8b46-2ddbde7d015a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.147061 May 11 06:44:08.961785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 294/618] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:08 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:09.327687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:09.328288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:09.334460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.334911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:09.335686 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.336106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:09.466379 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:09.473517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b7640cd5-d314-4e4e-8768-d7115f11d6ca tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.149555 May 11 06:44:09.474079 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 325/619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:09 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:09.547985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:09.548663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:09.555133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.555547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:09.556329 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.556770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:09.696341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:09.704480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:09.706042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:09.707243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-695ebdb3-2693-4246-a324-4e349dd16e17 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.163965 May 11 06:44:09.707881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 295/620] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:09 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:09.977991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:09.978588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:09.982573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:44:09.984249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 (ip 10.222.0.64) !!! May 11 06:44:09.986936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.987583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:09.989535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:09.990981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:10.208320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:10.215984 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-359f056f-bff7-4a97-8039-be8f6402ad74 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.241801 May 11 06:44:10.225437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 326/621] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:09 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:10.490930 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:10.491572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:10.497666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:10.498113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:10.498937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:10.499398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:10.729319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:10.730249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:10.737630 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:10.738090 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:10.738836 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:10.739287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:10.747901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:10.755585 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d342863a-78f4-4199-96da-21ce1995bf8e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.268430 May 11 06:44:10.756378 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 296/622] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:10 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:10.946821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:10.954828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:10.956405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:10.957548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-03d929d1-0cf1-49bf-a41b-193ee0acc2b8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1724 microversion: 2.20 time: 0.234553 May 11 06:44:10.958101 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 327/623] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:10 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:11.233644 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:11.234653 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:11.241140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.241950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.242630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.243066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.336831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-03350752-8a46-450d-8bd0-8fc55503a30f req-0fab236a-316f-4fa5-b34f-ef4d22e82216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8d3ad-c5ac-43be-9752-33e7891c2aec", "name": "network-vif-deleted", "tag": "aa0feff8-652c-4491-ae7e-15c889fc6734"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:11.350218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-03350752-8a46-450d-8bd0-8fc55503a30f req-0fab236a-316f-4fa5-b34f-ef4d22e82216 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.350653 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-03350752-8a46-450d-8bd0-8fc55503a30f req-0fab236a-316f-4fa5-b34f-ef4d22e82216 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.363950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-03350752-8a46-450d-8bd0-8fc55503a30f req-0fab236a-316f-4fa5-b34f-ef4d22e82216 service nova] Creating event network-vif-deleted:aa0feff8-652c-4491-ae7e-15c889fc6734 for instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec on hv-cinder-80475 May 11 06:44:11.369068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-03350752-8a46-450d-8bd0-8fc55503a30f req-0fab236a-316f-4fa5-b34f-ef4d22e82216 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 May 11 06:44:11.370238 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 328/624] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:11.413459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:11.421953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-007fdcf4-3854-4c7d-829c-a65c0b535421 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.193126 May 11 06:44:11.422693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 297/625] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:11 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:11.761923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:11.762500 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:11.772185 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.772388 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:11.772815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.772906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:11.773414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.773896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.779324 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.780051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.781063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.781574 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.859279 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lazy-loading 'services' on Instance uuid d3d4ab69-7025-4c29-9e86-88f48dec8d5b {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:11.916436 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:11.925625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7ef26741-4c4c-4b92-8f35-59b2343636d7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.156915 May 11 06:44:11.926158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 298/626] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:11 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:11.934021 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6dff922-0932-4cbc-acdd-abe03cb17173 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b/os-volume_attachments/30e1e03f-24ee-42ed-b15f-4bbe91f95748" status: 202 len: 0 microversion: 2.1 time: 0.177458 May 11 06:44:11.937566 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 329/627] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:44:11 2022] DELETE /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b/os-volume_attachments/30e1e03f-24ee-42ed-b15f-4bbe91f95748 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:44:11.977262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:11.977778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:11.984484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.984938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:11.985937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:11.986369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:12.017479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:12.017930 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:12.018380 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'fault' on Instance uuid 86b8d3ad-c5ac-43be-9752-33e7891c2aec {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:12.084432 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:12.094100 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:12.095650 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:12.096809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eece9afe-9c73-47a8-8637-963f1f3115e8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1372 microversion: 2.20 time: 0.123550 May 11 06:44:12.097368 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 299/628] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:11 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:44:12.440104 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:12.440800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:12.446934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:12.447421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:12.448447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:12.448888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:12.580955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:12.589548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ce21323c-f9e6-441f-befc-71822e72c762 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1736 microversion: 2.1 time: 0.153531 May 11 06:44:12.590153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 330/629] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:12 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:12.941850 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:12.942455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:12.948934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:12.949379 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:12.950846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:12.951307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.080755 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:13.087905 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-dae649cc-c38a-4820-b90f-8712d5d929e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.149882 May 11 06:44:13.088441 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 300/630] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:12 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:13.118747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:13.119412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:13.125747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.126192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.126952 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.127409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.158953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.159450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.159896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'fault' on Instance uuid 86b8d3ad-c5ac-43be-9752-33e7891c2aec {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:13.201348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:13.209036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:13.210523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:13.211687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da9b655b-26ae-4a4c-8ad7-d6d091389187 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1372 microversion: 2.20 time: 0.097501 May 11 06:44:13.212244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 331/631] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:13 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:44:13.606870 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:13.607638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:13.613693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.614145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.614910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.615384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.738946 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:13.747130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c74bf191-128c-41d2-a403-fb5e4e923ba5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1716 microversion: 2.1 time: 0.143977 May 11 06:44:13.747724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 301/632] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:13 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1716 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:13.845526 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:13.846017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:13.851830 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.852288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.853036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.853468 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.931949 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] HTTP exception thrown: Cannot 'detach_volume' instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 while it is in vm_state rescued May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Request method failure captured: May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments/263816dd-5e43-441e-93e6-1471d3b82ade HTTP/1.1 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oVFNC3chn7NkOA_8EUeVavAZOmL4jJPOIePeS4PmnZDqh1iOO0IHhqfL8svd_gFAEWel3AClgmqc2APtM42fKrqSpdfT3EC3PAD_F6t86viWoyVXa8Ps7SQnsTQQPz06Z8DhCRcbmuvR9XM4PUckdDLGL_FrY3lZUBl6n3HIZzZA4 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:44:13.933583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 0334273a56994a7abfa3d72006f7a7a4 May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:44:13.935816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Cannot 'detach_volume' instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 while it is in vm_state rescued May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'server_id': '1c304119-9fe2-4635-ac4f-081c9c1ab062', 'id': '263816dd-5e43-441e-93e6-1471d3b82ade'} May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:44:13.936636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 while it is in vm_state rescued May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 while it is in vm_state rescued May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:13.938153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Returning 409 to user: Cannot 'detach_volume' instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 while it is in vm_state rescued {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:44:13.939390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-231afb46-ad76-48ed-95e5-e9cf0be627a1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments/263816dd-5e43-441e-93e6-1471d3b82ade" status: 409 len: 152 microversion: 2.1 time: 0.094004 May 11 06:44:13.939390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 332/633] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:44:13 2022] DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments/263816dd-5e43-441e-93e6-1471d3b82ade => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 06:44:13.946282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:13.946806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:13.953961 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.954401 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:13.955148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:13.955597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.019472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-eef27926-4231-470c-bcb5-902978a88828 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/action" status: 202 len: 0 microversion: 2.1 time: 0.076677 May 11 06:44:14.020044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 302/634] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:44:13 2022] POST /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:44:14.028159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:14.029114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:14.034950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.035423 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.036174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.036622 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.105403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:14.106729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:14.112701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.113147 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.113909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.114343 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.202656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:14.210517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4e0c6236-dbfc-48e8-b4ac-a937e301123a tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1724 microversion: 2.1 time: 0.186367 May 11 06:44:14.211088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 333/635] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:14 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:14.229760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:14.230492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:14.236890 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.237436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.238198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.238631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.257636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:14.268941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1545c2b0-0ee1-4764-a675-4af70b59498c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.167634 May 11 06:44:14.269582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 303/636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:14 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:14.277657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:14.278103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:14.278546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'fault' on Instance uuid 86b8d3ad-c5ac-43be-9752-33e7891c2aec {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:14.321510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:14.329366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:14.330885 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:14.332056 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-be9f6f5d-39e6-4e06-875d-289531aa1d29 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 200 len: 1372 microversion: 2.20 time: 0.106146 May 11 06:44:14.332697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 334/637] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:14 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:44:15.142696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.143216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:15.149534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.149976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.150734 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.151167 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.175588 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:44:15.228198 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.228831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:15.235970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.236416 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.237214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.237641 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.256829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ce0b8b89-bf22-4cff-ada3-5fcdc7f9798e tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 204 len: 0 microversion: 2.1 time: 0.117576 May 11 06:44:15.257676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 304/638] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:44:15 2022] DELETE /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:44:15.266507 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.267205 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:15.273357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.273809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.274589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.275026 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.421018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:15.429175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-08c74d21-d7cf-4c67-8ed1-c7ffc04360e0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1724 microversion: 2.1 time: 0.205009 May 11 06:44:15.429802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 335/639] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:15 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:15.453767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:15.462242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1b94c194-fc71-4be6-86fa-3197418a9fc1 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1515 microversion: 2.1 time: 0.200329 May 11 06:44:15.462841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 305/640] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:15 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:15.468531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.469133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:15.474931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.475411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.476169 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.476599 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.489871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec HTTP/1.1 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:44:15.491552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:44:15.492990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '86b8d3ad-c5ac-43be-9752-33e7891c2aec'} May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:44:15.493859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:44:15.495414 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:44:15.497832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:44:15.497832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b6cd0d6c-fe09-4161-9bcc-dcfc74e68d76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 404 len: 111 microversion: 2.20 time: 0.028274 May 11 06:44:15.497832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 306/641] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:15 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:44:15.501924 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a1bb0220-54f5-4d13-98cd-9b288de9f8a0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '.version_select at 0x7fc5c846da60>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.506766 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:15.507658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:15.514186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.514726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.515627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:15.516123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:15.524719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a1bb0220-54f5-4d13-98cd-9b288de9f8a0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330297397" status: 204 len: 0 microversion: 2.20 time: 0.026184 May 11 06:44:15.525575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 307/642] 10.222.0.64 () {60 vars in 1261 bytes} [Wed May 11 06:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330297397 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:44:15.667318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:15.676222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa576116-1c3b-44f0-837b-167cdced4bc8 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.242710 May 11 06:44:15.686468 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 336/643] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:15 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:16.174477 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e3673fe2-21f3-4ec7-884b-364e0bc3cbb9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: .version_select at 0x7fc5c843b9d0>, body: {"keypair": {"name": "tempest-keypair-1776342463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgp0+eoY+GxPDklJvOLGn03lC2OB2OLtaowdIYrh2Vkjb1MyuUJiyDTae8e/0wvgMNgJAh9GsQt6ID1RASRlAngOmxyKFzq6nViv6mvgkuotvhx2RluDT3jOPbCGhAcAA=="}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:16.191337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-e3673fe2-21f3-4ec7-884b-364e0bc3cbb9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for project ea42234bb6844ce88afe0725d859863e. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:44:16.195097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-e3673fe2-21f3-4ec7-884b-364e0bc3cbb9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for user 1f2d12e60ae147198c3940c510616285 and project ea42234bb6844ce88afe0725d859863e. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:44:16.219009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e3673fe2-21f3-4ec7-884b-364e0bc3cbb9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048888 May 11 06:44:16.219684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 308/644] 10.222.0.64 () {62 vars in 1199 bytes} [Wed May 11 06:44:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 06:44:16.448015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:16.448951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:16.455434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.455950 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.456774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.457272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.479531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:16.480268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:16.486700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.487152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.488145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.488772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.661042 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:16.668615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:16.670326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f2582186-b955-4dc0-8f21-cde01322a7f8 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1724 microversion: 2.1 time: 0.226115 May 11 06:44:16.671286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 337/645] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:16 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:16.680762 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9e42768b-bcc2-47c3-90c5-50d3c8991cc2 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1515 microversion: 2.1 time: 0.205237 May 11 06:44:16.681419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 309/646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:16 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:16.692673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:16.693504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:16.700836 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.701270 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.702031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:16.702467 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:16.925156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:16.932405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2751263e-7423-4240-a33e-ae8f5b2272fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.243895 May 11 06:44:16.933067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 338/647] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:16 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:17.618593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1133552580", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db82dec6-6180-4aae-84ec-afed65e8ca62"}], "security_groups": [{"name": "tempest-securitygroup--135706047"}], "key_name": "tempest-keypair-1776342463", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:17.671218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-0185173a-3a8f-46c2-a6c4-75efbda00e4b req-fe2efb0e-9ff2-4278-be94-fdf908be7446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d780cb-2ea7-4645-937d-03eef82ae3c4", "name": "network-vif-plugged", "status": "completed", "tag": "46f06357-bb6c-4461-a2f7-c4a89a2e46fe"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:17.680039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0185173a-3a8f-46c2-a6c4-75efbda00e4b req-fe2efb0e-9ff2-4278-be94-fdf908be7446 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:17.680614 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0185173a-3a8f-46c2-a6c4-75efbda00e4b req-fe2efb0e-9ff2-4278-be94-fdf908be7446 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:17.692980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-0185173a-3a8f-46c2-a6c4-75efbda00e4b req-fe2efb0e-9ff2-4278-be94-fdf908be7446 service nova] Creating event network-vif-plugged:46f06357-bb6c-4461-a2f7-c4a89a2e46fe for instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 on hv-cinder-80475 May 11 06:44:17.698454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-0185173a-3a8f-46c2-a6c4-75efbda00e4b req-fe2efb0e-9ff2-4278-be94-fdf908be7446 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030603 May 11 06:44:17.700160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 339/648] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:44:17.727887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] validate_networks() for [('db82dec6-6180-4aae-84ec-afed65e8ca62', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:44:17.765863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:17.766585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:17.772694 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:17.773132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:17.773892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:17.774326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:17.962589 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:17.971432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-04b6b60d-b23c-4e28-905b-41a4304299ce tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1724 microversion: 2.1 time: 0.269895 May 11 06:44:17.972077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 340/649] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:17 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:17.976742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:17.977343 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:17.983539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:17.983979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:17.984728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:17.985158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.188892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:18.196272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6459463d-7edc-46b0-948e-f76f7187c8e3 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1515 microversion: 2.1 time: 0.223212 May 11 06:44:18.196845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 341/650] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:17 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:18.201639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:18.202253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:18.207975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.208366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.209138 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.209574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.216670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:44:18.217089 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:44:18.217559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:44:18.217964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:44:18.218373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:44:18.226805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.227245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.228105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.228534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.245270 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for project ea42234bb6844ce88afe0725d859863e. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:44:18.249597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Getting quotas for user 1f2d12e60ae147198c3940c510616285 and project ea42234bb6844ce88afe0725d859863e. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:44:18.261256 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:44:18.264063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:44:18.326352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-900ba1b8-ab69-428d-a331-1e25c4944f3c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.711983 May 11 06:44:18.333223 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 310/651] 10.222.0.64 () {62 vars in 1187 bytes} [Wed May 11 06:44:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 06:44:18.339553 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:18.340717 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:18.357297 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:18.366136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0f77fba6-ba2f-416e-a7de-f01a13b86b1b tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.168239 May 11 06:44:18.369254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 342/652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:18 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:18.405578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:18.412790 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:18.414377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:18.415567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5b0ea21a-16e7-4d50-90ac-dc4934c8e2a6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1282 microversion: 2.20 time: 0.081132 May 11 06:44:18.416123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 311/653] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:18 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:18.989320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:18.989837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:18.996092 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.996567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:18.997317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:18.997745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.132265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.143139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-621e263a-99d9-41ec-b0d7-7a72d50001c4 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1730 microversion: 2.1 time: 0.157648 May 11 06:44:19.143818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 343/654] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:18 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:19.156163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-b5c4a811-abbf-4e09-aa88-aabb331a3ab3 req-f64fc6e6-91b7-4d64-9db9-845ac77bc3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d4ab69-7025-4c29-9e86-88f48dec8d5b", "name": "network-vif-deleted", "tag": "345508dc-7ee8-4f6f-968f-12fa627c66a9"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:19.160627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:19.161785 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:19.167754 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b5c4a811-abbf-4e09-aa88-aabb331a3ab3 req-f64fc6e6-91b7-4d64-9db9-845ac77bc3d2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.168794 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b5c4a811-abbf-4e09-aa88-aabb331a3ab3 req-f64fc6e6-91b7-4d64-9db9-845ac77bc3d2 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.169864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.170409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.171912 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.172446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.180984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-b5c4a811-abbf-4e09-aa88-aabb331a3ab3 req-f64fc6e6-91b7-4d64-9db9-845ac77bc3d2 service nova] Creating event network-vif-deleted:345508dc-7ee8-4f6f-968f-12fa627c66a9 for instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b on hv-cinder-80475 May 11 06:44:19.186375 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-b5c4a811-abbf-4e09-aa88-aabb331a3ab3 req-f64fc6e6-91b7-4d64-9db9-845ac77bc3d2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035201 May 11 06:44:19.187043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 312/655] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:19.213693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:19.214411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:19.221250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.221699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.222460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.222887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.266732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b5fa6b20-0792-415e-afce-0bf186747cec tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110370 May 11 06:44:19.271303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 344/656] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:44:19 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:44:19.294534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.303087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-247a3084-d9ea-4efc-abec-39d7bdb087c9 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1304 microversion: 2.1 time: 0.093519 May 11 06:44:19.303983 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 313/657] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:19 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:44:19.385135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:19.385747 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:19.392257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.392712 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.393478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.393915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.437103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:19.437724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:19.443721 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.444184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.444966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:19.445404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:19.519249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.527223 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.529736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.529875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e4e678b2-d2f5-450d-9316-22612b911924 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1334 microversion: 2.20 time: 0.098650 May 11 06:44:19.530623 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 314/658] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:19 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:19.548620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:19.555934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fbddd48b-0d46-4546-b10b-71701704dc56 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1366 microversion: 2.1 time: 0.174729 May 11 06:44:19.556512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 345/659] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:19 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:20.320692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:20.321864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:20.328517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.328969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.329742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.330175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.363934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.364384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.364868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lazy-loading 'fault' on Instance uuid d3d4ab69-7025-4c29-9e86-88f48dec8d5b {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:20.417050 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f7b1ca4478415c9b526c4e4b9e3ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05347ecf2f1e4379bfa0f96c9df28c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:20.437234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ec2f74bf-665a-46ab-b660-f5a8b2b46705 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 200 len: 1309 microversion: 2.1 time: 0.120405 May 11 06:44:20.439551 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 315/660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:20 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:20.548358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:20.548976 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:20.555701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.556160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.556946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.557388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.573947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:20.576568 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:20.583898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.584588 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.585448 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.585954 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.626821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:20.635895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:20.638183 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:20.639589 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c5b12f88-017b-4156-88ca-06d9703d6fe7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1342 microversion: 2.20 time: 0.095160 May 11 06:44:20.640443 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 346/661] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:20 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:20.723106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:20.730474 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1c7d6698-5525-49ed-91b4-925b17599f3c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1556 microversion: 2.1 time: 0.160763 May 11 06:44:20.731066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 316/662] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:20 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:44:20.746913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:20.747431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:20.753256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.753698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:20.754445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:20.754889 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.099244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f3b11d0e-86bc-478d-83eb-866cda28fa94 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.356623 May 11 06:44:21.100042 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 347/663] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:44:20 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-interface => generated 284 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:21.203607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}, {"name": "network-changed", "server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:21.211463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:21.211906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.223483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] Creating event network-changed:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:44:21.223990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] Creating event network-changed:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:44:21.228974 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-26cb8311-62e2-4a15-af1d-0fa38cf66944 req-f4b4b01a-cf2c-4d75-9467-b5dbd8e12f8a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029549 May 11 06:44:21.229767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 317/664] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:21.456736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:21.457351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] [instance: d3d4ab69-7025-4c29-9e86-88f48dec8d5b] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:21.463916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:21.464389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.465350 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:21.470401 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.498989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] HTTP exception thrown: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Request method failure captured: May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b HTTP/1.1 May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1q-JTDxWmwKEzM99hx6lyKlHA-XUF2nfq6-o8e1eR1fc4NjSVfRpGqCMTB2EEIuyl0RBZGTSO99FABjfN8LIbqHNzm2nawKOrj4-lMQ94BGTRzdQ370UjL5gLAr-A_BurefcyGFei52OaJUWgvdDoPjdzPpf8OO7bHBlTAFKNuTxvM May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 05347ecf2f1e4379bfa0f96c9df28c9c May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:44:21.500966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/05347ecf2f1e4379bfa0f96c9df28c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 05347ecf2f1e4379bfa0f96c9df28c9c May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1685477785 May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotTestJSON-1685477785-project May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 55f7b1ca4478415c9b526c4e4b9e3ca2 May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotTestJSON-1685477785-project May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. May 11 06:44:21.502309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'd3d4ab69-7025-4c29-9e86-88f48dec8d5b'} May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:44:21.503057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. May 11 06:44:21.506123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:44:21.507477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] Returning 404 to user: Instance d3d4ab69-7025-4c29-9e86-88f48dec8d5b could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:44:21.507477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5e9cd9ac-7160-41eb-8811-c4c3af203235 tempest-VolumesSnapshotTestJSON-1685477785 tempest-VolumesSnapshotTestJSON-1685477785-project] 10.222.0.64 "GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b" status: 404 len: 111 microversion: 2.1 time: 0.052942 May 11 06:44:21.512633 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 348/665] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:44:21 2022] GET /compute/v2.1/servers/d3d4ab69-7025-4c29-9e86-88f48dec8d5b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:44:21.658991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:21.659964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:21.672376 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:21.673113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.674253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:21.675617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:21.810416 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:21.820687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:21.822191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:21.826754 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-129bfbe4-9d60-4851-b31c-992c513dd888 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1340 microversion: 2.20 time: 0.172418 May 11 06:44:21.828894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 318/666] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:21 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1340 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:22.738043 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-edc7a44d-169a-4cb4-bb6a-13e9a81874ac req-5b74b38c-8b50-4b9d-83bd-b7d136a480b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d780cb-2ea7-4645-937d-03eef82ae3c4", "tag": "46f06357-bb6c-4461-a2f7-c4a89a2e46fe"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:22.749503 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-edc7a44d-169a-4cb4-bb6a-13e9a81874ac req-5b74b38c-8b50-4b9d-83bd-b7d136a480b4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:22.750296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-edc7a44d-169a-4cb4-bb6a-13e9a81874ac req-5b74b38c-8b50-4b9d-83bd-b7d136a480b4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:22.763196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-edc7a44d-169a-4cb4-bb6a-13e9a81874ac req-5b74b38c-8b50-4b9d-83bd-b7d136a480b4 service nova] Creating event network-changed:46f06357-bb6c-4461-a2f7-c4a89a2e46fe for instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 on hv-cinder-80475 May 11 06:44:22.770264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-edc7a44d-169a-4cb4-bb6a-13e9a81874ac req-5b74b38c-8b50-4b9d-83bd-b7d136a480b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035714 May 11 06:44:22.771911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 349/667] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:22.846130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:22.848072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:22.860088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:22.860551 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:22.861545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:22.861989 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:23.185865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:23.198526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:23.201510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:23.203595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e79e7079-e5cd-4259-899b-fe154fd282e4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.361053 May 11 06:44:23.204434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 319/668] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:22 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:23.250933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-f317abca-072c-4aed-9a60-f4616b68867c req-d9bfc174-8415-44c0-8cd2-97467a61598a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:23.263304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f317abca-072c-4aed-9a60-f4616b68867c req-d9bfc174-8415-44c0-8cd2-97467a61598a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:23.264077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f317abca-072c-4aed-9a60-f4616b68867c req-d9bfc174-8415-44c0-8cd2-97467a61598a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:23.279199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-f317abca-072c-4aed-9a60-f4616b68867c req-d9bfc174-8415-44c0-8cd2-97467a61598a service nova] Creating event network-changed:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:44:23.286409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-f317abca-072c-4aed-9a60-f4616b68867c req-d9bfc174-8415-44c0-8cd2-97467a61598a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043046 May 11 06:44:23.287049 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 350/669] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:24.221180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:24.221779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:24.228029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:24.228471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:24.229219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:24.229644 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:24.358325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:24.365886 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:24.367400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:24.368480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-090003d6-a43c-46b6-bba7-6c25112b5f8d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.151139 May 11 06:44:24.369029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 320/670] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:24 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:25.387162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:25.387887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:25.394224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:25.394678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:25.395479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:25.395915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:25.525062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:25.533926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:25.535435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:25.536523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ee3b1a31-db85-4d7e-b3c2-ecbae8c1982f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.154110 May 11 06:44:25.537072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 351/671] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:25 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:26.554865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:26.555662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:26.562554 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:26.563004 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:26.563801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:26.564235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:26.694313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:26.702848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:26.704382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:26.705489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-99e8a4c4-b026-488b-a0b9-e31adf490e42 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.154495 May 11 06:44:26.706023 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 321/672] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:26 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:27.723585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:27.724196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:27.733533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:27.734221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:27.735039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:27.735508 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:27.872410 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:27.880171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:27.881695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:27.882784 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5605ad35-3eca-4b2b-a7f3-524e70d575c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.163289 May 11 06:44:27.883358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 352/673] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:27 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:44:28.900885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:28.901494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:28.908233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:28.908684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:28.909775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:28.910245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:29.060131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:29.068480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:29.070130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:29.071321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8ebc5d00-3e67-48a6-bd1c-b3e5a216274c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.174245 May 11 06:44:29.072252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 322/674] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:28 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:30.089640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:30.090812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:30.097109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:30.097559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:30.098330 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:30.098762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:30.245753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:30.254477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:30.255957 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:30.257270 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-63132187-9025-42a9-95e4-c2dead308ee3 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.171439 May 11 06:44:30.257832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 353/675] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:30 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:31.274894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:31.275545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:31.282263 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:31.282709 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:31.283516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:31.283955 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:31.407520 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:31.415210 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:31.416720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:31.417941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1268c3b7-9023-4a5a-b6c1-aabc0bf3f3e0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.146824 May 11 06:44:31.418496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 323/676] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:31 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:32.436372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:32.437002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:32.443210 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:32.443682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:32.444430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:32.444857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:32.575352 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:32.582936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:32.584458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:32.585578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b3277225-c0c4-4836-a384-87aca7a22fe4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.153685 May 11 06:44:32.586249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 354/677] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:32 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:33.604310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:33.604952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:33.611645 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:33.612085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:33.612844 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:33.613272 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:33.748258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:33.756070 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:33.757567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:33.758656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9f6b422d-ad7d-4506-b468-f5c5d46b7569 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.158262 May 11 06:44:33.759228 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 324/678] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:33 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:33.968681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-98ff9728-c4f8-4cda-8513-c4ad41dbb209 req-da5a7d5d-81ea-42c3-bcfc-097468440570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "name": "network-vif-plugged", "status": "completed", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:33.979518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-98ff9728-c4f8-4cda-8513-c4ad41dbb209 req-da5a7d5d-81ea-42c3-bcfc-097468440570 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:33.979971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-98ff9728-c4f8-4cda-8513-c4ad41dbb209 req-da5a7d5d-81ea-42c3-bcfc-097468440570 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:33.992179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-98ff9728-c4f8-4cda-8513-c4ad41dbb209 req-da5a7d5d-81ea-42c3-bcfc-097468440570 service nova] Creating event network-vif-plugged:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:44:33.997241 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-98ff9728-c4f8-4cda-8513-c4ad41dbb209 req-da5a7d5d-81ea-42c3-bcfc-097468440570 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 May 11 06:44:33.997838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 355/679] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:34.778466 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:34.779080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:34.785409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:34.785857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:34.786619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:34.787054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:34.915670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:34.923947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:34.925457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:34.926550 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3b5a0027-0efa-4cbc-a57a-f4067cfdefcc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.152533 May 11 06:44:34.927104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 325/680] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:34 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:35.945692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:35.946313 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:35.953535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:35.953990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:35.954756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:35.955195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:36.079926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:36.087616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:36.089147 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:36.090871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c36e9060-bf93-4f21-a9da-6e5ba7bea1e1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1407 microversion: 2.20 time: 0.149473 May 11 06:44:36.091471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 356/681] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:35 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:37.107892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:37.108435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:37.115114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:37.115600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:37.116361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:37.116806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:37.243237 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:37.251465 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:37.252989 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:44:37.254126 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-080d1f55-9876-4022-be6c-ec9072102ff6 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1599 microversion: 2.20 time: 0.150238 May 11 06:44:37.254679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 326/682] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:44:37 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:44:37.271900 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:37.272406 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:37.278598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:37.279059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:37.279851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:37.280282 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:37.358040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0f5382d1-3cec-42d3-95c3-ca7d5f242d82 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089901 May 11 06:44:37.358571 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 357/683] 10.222.0.64 () {60 vars in 1315 bytes} [Wed May 11 06:44:37 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:44:38.632717 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-dc0ec18b-9723-4273-9f39-03f630fa55d1 req-c03b2e09-19b0-4472-9de0-4d75834eeddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:44:38.641361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-dc0ec18b-9723-4273-9f39-03f630fa55d1 req-c03b2e09-19b0-4472-9de0-4d75834eeddd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:38.641695 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-dc0ec18b-9723-4273-9f39-03f630fa55d1 req-c03b2e09-19b0-4472-9de0-4d75834eeddd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:38.652705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-dc0ec18b-9723-4273-9f39-03f630fa55d1 req-c03b2e09-19b0-4472-9de0-4d75834eeddd service nova] Creating event network-changed:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:44:38.657781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-dc0ec18b-9723-4273-9f39-03f630fa55d1 req-c03b2e09-19b0-4472-9de0-4d75834eeddd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087651 May 11 06:44:38.658395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 327/684] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:44:59.301459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:59.305398 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:59.313613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:59.315205 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:59.316193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:59.316635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:59.406920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'services' on Instance uuid 1c304119-9fe2-4635-ac4f-081c9c1ab062 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:44:59.492763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cefaf9e6-74d3-4b47-af55-f3a18bfb1f16 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments/263816dd-5e43-441e-93e6-1471d3b82ade" status: 202 len: 0 microversion: 2.1 time: 0.196514 May 11 06:44:59.493741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 358/685] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:44:59 2022] DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments/263816dd-5e43-441e-93e6-1471d3b82ade => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:44:59.504643 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:44:59.506562 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:44:59.514871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:59.515652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:59.516760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:44:59.517527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:44:59.572081 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ba2dbf63-f6cc-4f06-9213-8a4543fe3d4b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073668 May 11 06:44:59.572990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 328/686] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:44:59 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:00.585973 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:00.587184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:00.595212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:00.595702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:00.596573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:00.597079 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:00.640786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e6d698a7-dc27-4a97-b1cb-8c66221a6116 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059632 May 11 06:45:00.641501 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 359/687] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:00 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:01.654586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:01.656262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:01.662951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.663444 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:01.664213 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.664804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:01.696098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-aa1d923d-8ede-404f-b7a4-a46fa94219ad tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046426 May 11 06:45:01.696948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 329/688] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:01 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:45:01.775160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:01.775719 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:01.782850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.783409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:01.784527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.785121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:01.813454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:45:01.917491 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aab45436-d224-4412-9053-ca510b02cfc1 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 204 len: 0 microversion: 2.1 time: 0.145824 May 11 06:45:01.918179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 360/689] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:45:01 2022] DELETE /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:45:01.931564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:01.933279 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:01.939537 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.940248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:01.941282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:01.941776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:02.081838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:02.092622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fbad14b0-69ee-460c-b35b-4dc80091aeaa tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.165120 May 11 06:45:02.102087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 330/690] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:01 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:03.110385 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:03.111080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:03.117914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:03.118370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:03.119153 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:03.119701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:03.267123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:03.274713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3b1154b2-a63c-4801-b554-be3de2c33d70 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.168754 May 11 06:45:03.275658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 361/691] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:03 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:03.595018 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1153c60e-cd2b-4d52-b1e2-ec682d1bc60f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'create', calling method: .version_select at 0x7fc5c842a280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2017886493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMLyTdRS9HtN1arYFd+pFeRjjWBuLNTEmIoGI2L5b1qUD12y3LR8jPhXOSVKeP6aUVuEGgsSQL2m4pO0wc+6Ybzk/IzhMxi6ocqX2Au8TgNcGhfV2FspONJHSVKC5gyvA=="}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:03.608781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-1153c60e-cd2b-4d52-b1e2-ec682d1bc60f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Getting quotas for project ee00a37abf8a49eba7d06738e181eb4b. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:03.613334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-1153c60e-cd2b-4d52-b1e2-ec682d1bc60f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Getting quotas for user bd7b114dcefa4088851a61b3c7283b21 and project ee00a37abf8a49eba7d06738e181eb4b. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:03.635353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1153c60e-cd2b-4d52-b1e2-ec682d1bc60f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044141 May 11 06:45:03.636509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 331/692] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:45:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:03.685760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-684801876", "imageRef": "f6654081-5abb-4a39-821d-9a1d5c48974c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2017886493", "networks": [{"uuid": "eee35abb-92b2-4bc1-98fe-bda487493108"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:03.733327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] validate_networks() for [('eee35abb-92b2-4bc1-98fe-bda487493108', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:45:04.176439 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:45:04.177017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:45:04.177312 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:45:04.177716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:45:04.178154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:45:04.187876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:04.188321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:04.189116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:04.189551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:04.206399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Getting quotas for project ee00a37abf8a49eba7d06738e181eb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:04.210594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Getting quotas for user bd7b114dcefa4088851a61b3c7283b21 and project ee00a37abf8a49eba7d06738e181eb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:04.222179 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:45:04.224377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6654081-5abb-4a39-821d-9a1d5c48974c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:45:04.270059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0121998e-556b-47ec-82fa-b5cd6860042a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588789 May 11 06:45:04.270708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 362/693] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:45:04.280352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b407598a-659f-4030-9790-8d50bc7ee802 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:04.280960 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b407598a-659f-4030-9790-8d50bc7ee802 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:04.292505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:04.293130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:04.299752 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:04.300207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:04.301010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:04.301450 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:04.339703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b407598a-659f-4030-9790-8d50bc7ee802 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:04.347186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b407598a-659f-4030-9790-8d50bc7ee802 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1258 microversion: 2.1 time: 0.070622 May 11 06:45:04.347858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 332/694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:04 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:04.446953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:04.456876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6d953e48-0e25-493d-9bad-75f7f9a58648 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.168706 May 11 06:45:04.457385 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 363/695] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:04 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:05.364689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:05.365284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:05.372270 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:05.372864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:05.373635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:05.374064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:05.437888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:05.445302 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-305edd31-c3e8-4d54-b903-217f1306a680 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1262 microversion: 2.1 time: 0.084405 May 11 06:45:05.445879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 333/696] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:05 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:05.473840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:05.474579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:05.481637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:05.482099 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:05.482865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:05.483337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:05.609390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:05.617545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-225c9a72-385f-4aab-9759-f8a839796b51 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.147520 May 11 06:45:05.618059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 364/697] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:05 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:06.461853 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:06.462461 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:06.469332 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:06.469779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:06.470535 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:06.470969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:06.531671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:06.538819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f5df4fe8-65cd-4ed0-b62c-44d3be627947 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1310 microversion: 2.1 time: 0.080799 May 11 06:45:06.539408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 334/698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:06 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:06.633892 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:06.634495 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:06.641498 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:06.641888 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:06.642658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:06.643100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:06.773455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:06.781733 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fb06ee2d-0bfe-45aa-9877-dfc618ae4a52 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.151621 May 11 06:45:06.782360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 365/699] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:06 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:07.557838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:07.560566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:07.588479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.590432 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:07.592709 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.593389 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:07.634980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:07.636869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:07.650354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.652801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:07.658166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.658552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:07.726340 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-41db5619-ded4-4616-9ce0-8086448e1751 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/ips" status: 200 len: 150 microversion: 2.1 time: 0.095036 May 11 06:45:07.731742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 366/700] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:45:07 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:07.800226 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:07.800965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:07.817089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.818009 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:07.822732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:07.826437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:08.319341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:08.327111 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-72f1103e-55f0-4240-ac8e-d2a002421dc0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.774282 May 11 06:45:08.333825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 335/701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:07 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:08.400552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:08.409731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8319cd54-1e84-4f64-9abe-9ac87513675b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1690 microversion: 2.1 time: 0.615052 May 11 06:45:08.411721 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 367/702] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:07 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1690 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:08.837701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-7b8a2600-f836-4a74-befe-6e352e79f6e1 req-500015c4-e90b-4004-a98f-11ad9e817f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c304119-9fe2-4635-ac4f-081c9c1ab062", "name": "network-vif-deleted", "tag": "c3a90bd8-246c-4327-a910-1612c24265cb"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:08.857798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-7b8a2600-f836-4a74-befe-6e352e79f6e1 req-500015c4-e90b-4004-a98f-11ad9e817f99 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:08.858253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-7b8a2600-f836-4a74-befe-6e352e79f6e1 req-500015c4-e90b-4004-a98f-11ad9e817f99 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:08.879199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-7b8a2600-f836-4a74-befe-6e352e79f6e1 req-500015c4-e90b-4004-a98f-11ad9e817f99 service nova] Creating event network-vif-deleted:c3a90bd8-246c-4327-a910-1612c24265cb for instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 on hv-cinder-80475 May 11 06:45:08.889070 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-7b8a2600-f836-4a74-befe-6e352e79f6e1 req-500015c4-e90b-4004-a98f-11ad9e817f99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306244 May 11 06:45:08.890166 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 336/703] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:09.349922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:09.350435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:09.368744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.369206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.370546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.370988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.371677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8979f39c-0f3e-4565-9d7e-edbed49911b9"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:09.373389 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:09.380851 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.381575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.382543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.383138 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.631581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:09.639455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3be36999-bb41-4771-9cb9-60949f4d2b26 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.293335 May 11 06:45:09.644372 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 368/704] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:09 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:09.655835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-9798ec80-04e1-42b7-8461-945d7b885550 req-9c029976-cc03-4f1b-b2bc-a5a8b8818900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:09.671403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9798ec80-04e1-42b7-8461-945d7b885550 req-9c029976-cc03-4f1b-b2bc-a5a8b8818900 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.672263 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9798ec80-04e1-42b7-8461-945d7b885550 req-9c029976-cc03-4f1b-b2bc-a5a8b8818900 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.684731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-9798ec80-04e1-42b7-8461-945d7b885550 req-9c029976-cc03-4f1b-b2bc-a5a8b8818900 service nova] Creating event network-changed:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:45:09.689948 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-9798ec80-04e1-42b7-8461-945d7b885550 req-9c029976-cc03-4f1b-b2bc-a5a8b8818900 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043917 May 11 06:45:09.691201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 369/705] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:09.701615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:09.703257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:09.713423 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.714690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.715664 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:09.716294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:09.789392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:09.799141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a5d62359-0551-4794-b117-05fd3d1d4970 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.106374 May 11 06:45:09.799838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 370/706] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:09 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:10.661436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:10.662084 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:10.669408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:10.669932 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:10.670928 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:10.671521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:10.810770 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:10.820342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f5f6bd55-bcf6-463b-8263-6fd3f92442d6 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.163661 May 11 06:45:10.821258 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 371/707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:10 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:10.826163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:10.826994 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:10.833466 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:10.834005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:10.834843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:10.835304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:10.906479 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:10.914512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dd5e178e-6a50-42a7-bbec-b3ebe1ae012f tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.092057 May 11 06:45:10.915091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 372/708] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:10 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:11.837800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:11.838483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:11.845455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:11.845931 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:11.846942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:11.847421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:11.997922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:12.005331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-08a91bcf-4650-497a-9bb9-df8631d08b43 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.171489 May 11 06:45:12.006126 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 373/709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:11 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:12.010287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:12.011452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:12.017477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:12.017918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:12.018687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:12.019120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:12.087668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:12.095922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8ecc7853-5a55-4321-bc77-df0017aecaf5 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.088918 May 11 06:45:12.096438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 374/710] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:12 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:13.022020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:13.022699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:13.028869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:13.030462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:13.031551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:13.032080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:13.185685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:13.193113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-279590f5-c025-4b27-9443-e2adaa394c93 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.174965 May 11 06:45:13.193701 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 375/711] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:13 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:13.204080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:13.206251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:13.213724 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:13.214524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:13.215849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:13.216680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:13.282838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:13.290822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1257d0fa-fc74-43ec-bd0c-3a581c6da5ff tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.090444 May 11 06:45:13.292156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 376/712] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:13 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:14.210728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:14.211484 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:14.218511 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:14.218967 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:14.219809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:14.220234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:14.357933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:14.365690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6bf0e385-d88b-4423-8ca1-380b2cdcdf86 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.158800 May 11 06:45:14.366562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 377/713] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:14 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:14.371387 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:14.372229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:14.378906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:14.379418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:14.380209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:14.380650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:14.450741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:14.458324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d5f7d39f-2cd3-4d51-83ef-a5301851f081 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.090952 May 11 06:45:14.458903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 378/714] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:14 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:15.383441 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:15.384250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:15.391394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:15.391918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:15.392780 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:15.393215 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:15.526996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:15.534494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f80c1570-530f-4773-8f42-fbc41aaa28d2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.155329 May 11 06:45:15.535071 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 379/715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:15 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:15.539431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:15.540022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:15.546156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:15.546600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:15.547373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:15.547812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:15.610470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:15.622089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ca7e93f3-68e5-44d9-8854-982965f93381 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.085952 May 11 06:45:15.622685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 380/716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:15 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:16.551798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:16.552394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:16.559288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:16.559756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:16.560512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:16.560943 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:16.688142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:16.695392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9d7eab74-8807-42ec-8a9e-d250f3a20b11 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.147409 May 11 06:45:16.695963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 381/717] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:16 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:16.700526 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:16.701130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:16.706602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:16.707058 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:16.707879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:16.708319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:16.771257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:16.779134 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d6cabcee-c7e0-4307-be29-7570d0f61c46 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 200 len: 1623 microversion: 2.1 time: 0.082217 May 11 06:45:16.779745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 382/718] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:16 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 1623 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:17.412664 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3435aa0c-db37-4886-bfe7-7e7d22b1f93d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.052221 May 11 06:45:17.413271 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 337/719] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:45:09 2022] POST /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 194 bytes in 8054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:17.711562 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:17.712189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:17.719436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:17.719882 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:17.720661 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:17.721069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:17.797021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:17.798114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: 1c304119-9fe2-4635-ac4f-081c9c1ab062] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:17.805895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:17.806339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:17.807602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:17.808048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:17.821240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] HTTP exception thrown: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Request method failure captured: May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 HTTP/1.1 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oVFNC3chn7NkOA_8EUeVavAZOmL4jJPOIePeS4PmnZDqh1iOO0IHhqfL8svd_gFAEWel3AClgmqc2APtM42fKrqSpdfT3EC3PAD_F6t86viWoyVXa8Ps7SQnsTQQPz06Z8DhCRcbmuvR9XM4PUckdDLGL_FrY3lZUBl6n3HIZzZA4 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:45:17.823660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 0334273a56994a7abfa3d72006f7a7a4 May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. May 11 06:45:17.825308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '1c304119-9fe2-4635-ac4f-081c9c1ab062'} May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:45:17.826222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. May 11 06:45:17.827555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:17.828736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Returning 404 to user: Instance 1c304119-9fe2-4635-ac4f-081c9c1ab062 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:45:17.828736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-10b09000-2bbd-4531-9225-0e47e386e97e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062" status: 404 len: 111 microversion: 2.1 time: 0.032201 May 11 06:45:17.828736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 338/720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:17 2022] GET /compute/v2.1/servers/1c304119-9fe2-4635-ac4f-081c9c1ab062 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:45:17.833677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4a45c78c-4729-41dc-a75b-075c9e0eb909 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '.version_select at 0x7fc5c844f700>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:17.851569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4a45c78c-4729-41dc-a75b-075c9e0eb909 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656099014" status: 202 len: 0 microversion: 2.1 time: 0.021356 May 11 06:45:17.852066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 339/721] 10.222.0.64 () {58 vars in 1220 bytes} [Wed May 11 06:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656099014 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:45:17.865301 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:17.872784 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7b3c1b9b-ff95-48e6-a39c-68025df910cd tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.165073 May 11 06:45:17.873362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 383/722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:17 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:18.892349 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:18.893018 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:18.900044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:18.900492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:18.901912 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:18.902352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:19.067913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:19.078213 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-24cb570f-85cd-4c48-b9a6-051918c22ded tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.192048 May 11 06:45:19.078970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 340/723] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:18 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:20.096201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:20.096826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:20.103415 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:20.103943 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:20.104786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:20.105289 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:20.240600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:20.247996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62c9db02-f3c2-490c-b90a-30b247eba12a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.156129 May 11 06:45:20.248571 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 384/724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:20 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:21.264365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:21.264972 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:21.271148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.271625 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.272377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.272803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.302512 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:21.303018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:21.309317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.309769 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.310535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.310969 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.335844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:45:21.411463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0a7489ad-991c-47ae-8545-9ede75e8db11 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 204 len: 0 microversion: 2.1 time: 0.112232 May 11 06:45:21.412061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 385/725] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:45:21 2022] DELETE /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:45:21.415526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:21.421334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:21.422024 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:21.424193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3d91e516-39fd-47e4-8196-e492c10285c2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.163689 May 11 06:45:21.424759 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 341/726] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:21 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:21.433400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.433400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.433400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:21.433400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:21.559741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:21.566963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c60d5f61-a705-49ca-b362-c92f3749e642 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1507 microversion: 2.1 time: 0.150589 May 11 06:45:21.567560 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 386/727] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:21 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:22.192044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-2f0e6e27-95db-40d6-80af-a0029606162d req-707e03fe-edee-4ab0-ba3a-4d3b45ec8ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "name": "network-vif-plugged", "status": "completed", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:22.200821 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-2f0e6e27-95db-40d6-80af-a0029606162d req-707e03fe-edee-4ab0-ba3a-4d3b45ec8ef3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.201261 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-2f0e6e27-95db-40d6-80af-a0029606162d req-707e03fe-edee-4ab0-ba3a-4d3b45ec8ef3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.211791 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-2f0e6e27-95db-40d6-80af-a0029606162d req-707e03fe-edee-4ab0-ba3a-4d3b45ec8ef3 service nova] Creating event network-vif-plugged:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:45:22.216700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-2f0e6e27-95db-40d6-80af-a0029606162d req-707e03fe-edee-4ab0-ba3a-4d3b45ec8ef3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084631 May 11 06:45:22.217286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 342/728] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:22.440907 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:22.441522 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:22.447990 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.448707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.449477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.449910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.574714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:22.582837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e0d4277c-f6b1-4373-9a62-94f99a9e1633 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.145554 May 11 06:45:22.583464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 387/729] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:22 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:22.585154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:22.585858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:22.591838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.592291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.593059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.593494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.732854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:22.740093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5a42232a-6899-4e90-a0f6-792302eebf0c tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1507 microversion: 2.1 time: 0.159212 May 11 06:45:22.740647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 343/730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:22 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:22.968257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:22.968667 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:22.974537 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.974989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.975788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:22.976224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:22.999212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3884ed87-52b2-43c9-981a-f6d1096bf1a1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/ips" status: 200 len: 152 microversion: 2.20 time: 0.035688 May 11 06:45:22.999799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 388/731] 10.222.0.64 () {60 vars in 1288 bytes} [Wed May 11 06:45:22 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:45:23.598913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:23.599632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:23.607819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:23.608991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:23.609365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:23.609967 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:23.677579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-27dc8494-6dea-4181-9309-49c3ac8afb35 req-8828f393-2645-41da-803a-4ac53fbc8f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c818b-6fff-427f-bab8-3f96e99bb236", "name": "network-vif-deleted", "tag": "23e63531-0e9d-493d-ac18-7001469a18bd"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:23.687474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-27dc8494-6dea-4181-9309-49c3ac8afb35 req-8828f393-2645-41da-803a-4ac53fbc8f1a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:23.688250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-27dc8494-6dea-4181-9309-49c3ac8afb35 req-8828f393-2645-41da-803a-4ac53fbc8f1a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:23.701183 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-27dc8494-6dea-4181-9309-49c3ac8afb35 req-8828f393-2645-41da-803a-4ac53fbc8f1a service nova] Creating event network-vif-deleted:23e63531-0e9d-493d-ac18-7001469a18bd for instance ce8c818b-6fff-427f-bab8-3f96e99bb236 on hv-cinder-80475 May 11 06:45:23.706353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-27dc8494-6dea-4181-9309-49c3ac8afb35 req-8828f393-2645-41da-803a-4ac53fbc8f1a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 May 11 06:45:23.707515 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 389/732] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:23.758412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:23.759115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:23.766211 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:23.766873 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:23.768045 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:23.768666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:23.779112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:23.786597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-35566dff-de36-4174-a254-93f1d851b506 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1358 microversion: 2.1 time: 0.191690 May 11 06:45:23.787222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 344/733] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:23 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:23.839493 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:23.846777 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-44e0391e-7106-462b-a997-24cc1b64a289 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1465 microversion: 2.1 time: 0.093193 May 11 06:45:23.847367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 390/734] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:23 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1465 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:24.803205 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:24.803831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:24.810011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:24.810453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:24.811203 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:24.811662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:24.863364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:24.864105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:24.870247 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:24.870698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:24.871486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:24.871914 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:24.903961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:24.904659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:24.905272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'fault' on Instance uuid ce8c818b-6fff-427f-bab8-3f96e99bb236 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:24.956296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:24.964366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-457d26d6-e9a1-4e5a-a0d5-65acf1dbb799 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 200 len: 1311 microversion: 2.1 time: 0.104858 May 11 06:45:24.964952 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 391/735] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:24 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:24.971175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:24.979462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-db7cb553-e6ba-4133-9040-cb0fd572ed7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1547 microversion: 2.1 time: 0.179373 May 11 06:45:24.980049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 345/736] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:24 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:24.997961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:24.998850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.005394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.005955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.006767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.007202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.128352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:25.128872 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.133193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.134653 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.135231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.136021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.136450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.140685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-43b4fcee-7448-4449-84db-9f6acff70e99 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1547 microversion: 2.1 time: 0.147496 May 11 06:45:25.141351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 392/737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:24 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:25.156280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:25.158853 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lazy-loading 'flavor' on Instance uuid 596cbeb7-7356-4919-913a-a0adace78883 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:25.159671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.160445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Searching by: {'deleted': False, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b'} {{(pid=128924) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 06:45:25.167438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.167895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.168692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.169130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.260488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.multi_cell_list [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128924) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 06:45:25.357213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cfb2ae5e-9e25-439b-a8e1-59987370c49d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204293 May 11 06:45:25.357716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 393/738] 10.222.0.64 () {58 vars in 1124 bytes} [Wed May 11 06:45:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:25.367663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:25.368703 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.374993 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.375476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.376266 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.376833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.463552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7d1fe020-12af-412f-be80-57ee35b4cce9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/action" status: 202 len: 0 microversion: 2.20 time: 0.338679 May 11 06:45:25.464178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 346/739] 10.222.0.64 () {62 vars in 1318 bytes} [Wed May 11 06:45:25 2022] POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 06:45:25.472290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:25.472977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.479564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.480009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.480766 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.481190 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.509361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.516760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e706647e-3e76-43de-93ef-9be779167859 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1547 microversion: 2.1 time: 0.152809 May 11 06:45:25.517337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 394/740] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:25 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:25.626965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.636191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.637702 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:25.638948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-009a59c3-2bad-46c2-96f9-17359803a64b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.170503 May 11 06:45:25.648400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 347/741] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:25 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:45:25.952981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8979f39c-0f3e-4565-9d7e-edbed49911b9"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:25.954040 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.960219 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.960670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.961427 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.961861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.981775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:25.982526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: ce8c818b-6fff-427f-bab8-3f96e99bb236] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:25.988902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.989682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:25.990523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:25.991024 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.004518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] HTTP exception thrown: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Request method failure captured: May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 HTTP/1.1 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oVFNC3chn7NkOA_8EUeVavAZOmL4jJPOIePeS4PmnZDqh1iOO0IHhqfL8svd_gFAEWel3AClgmqc2APtM42fKrqSpdfT3EC3PAD_F6t86viWoyVXa8Ps7SQnsTQQPz06Z8DhCRcbmuvR9XM4PUckdDLGL_FrY3lZUBl6n3HIZzZA4 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:45:26.006219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 0334273a56994a7abfa3d72006f7a7a4 May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. May 11 06:45:26.007842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'ce8c818b-6fff-427f-bab8-3f96e99bb236'} May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:45:26.008651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. May 11 06:45:26.009776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:26.011208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Returning 404 to user: Instance ce8c818b-6fff-427f-bab8-3f96e99bb236 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:45:26.011208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0ffce0cb-7538-44a9-9aa3-f3b0fc54e666 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236" status: 404 len: 111 microversion: 2.1 time: 0.030273 May 11 06:45:26.011208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 348/742] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:25 2022] GET /compute/v2.1/servers/ce8c818b-6fff-427f-bab8-3f96e99bb236 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:45:26.016158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:26.016715 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:26.024571 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.025094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.026376 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.026816 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.044666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments HTTP/1.1 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 74 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:45:26.046384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {"volumeAttachment": {"volumeId": "8979f39c-0f3e-4565-9d7e-edbed49911b9"}} May 11 06:45:26.047871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'server_id': '09d780cb-2ea7-4645-937d-03eef82ae3c4', 'body': {'volumeAttachment': {'volumeId': '8979f39c-0f3e-4565-9d7e-edbed49911b9'}}} May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:26.048762 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:26.050291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 400 to user: Invalid volume: volume 8979f39c-0f3e-4565-9d7e-edbed49911b9 is already attached to instances: 09d780cb-2ea7-4645-937d-03eef82ae3c4 {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b2b2d13c-9ae9-4e48-939a-740bf7c714b5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098954 May 11 06:45:26.052201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 395/743] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:45:25 2022] POST /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:45:26.052809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:45:26.107932 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:26.108422 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:26.114981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.115481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.116955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.117448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.135749 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9ca2fd35-8003-4abc-8d41-345d239bace0 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "DELETE /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 204 len: 0 microversion: 2.1 time: 0.122379 May 11 06:45:26.140244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 349/744] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:45:26 2022] DELETE /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:45:26.145139 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:26.145667 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:26.152330 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.152780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.153648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.154096 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.205583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lazy-loading 'services' on Instance uuid 09d780cb-2ea7-4645-937d-03eef82ae3c4 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:26.279743 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-73f60a9c-6eee-478f-98bc-77b3263bae71 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments/8979f39c-0f3e-4565-9d7e-edbed49911b9" status: 202 len: 0 microversion: 2.1 time: 0.175460 May 11 06:45:26.280346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 396/745] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:45:26 2022] DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments/8979f39c-0f3e-4565-9d7e-edbed49911b9 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:45:26.287637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:26.288787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:26.289842 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:26.295542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-31037449-6c19-4284-a440-730ceca42b6b tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.154686 May 11 06:45:26.296078 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.301001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 350/746] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:26 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:26.301149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.301149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.301149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.326917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-69e066a6-b086-4050-b795-c33cc861afb1 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 May 11 06:45:26.328523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 397/747] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:26 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:26.658859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:26.659484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:26.665384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.665825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.666641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:26.667068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:26.796214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:26.803822 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:26.805313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:26.806446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ff1518d4-6eef-43b2-b1cf-0252198dabff tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.151518 May 11 06:45:26.807643 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 351/748] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:26 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:27.030305 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf33d6c1-ca56-474d-ad6e-991f17cccbcd"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:27.031451 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:27.037633 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.038078 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.038834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.039287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.312788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:27.313317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:27.319561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.320083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.320871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.321299 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.447996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:27.455405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e43a6b7e-4aa1-4f4f-8bcd-5ca3de21f233 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.146598 May 11 06:45:27.455970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 352/749] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:27 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:27.460360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:27.461310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:27.467125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.467597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.468347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.468777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.497168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1d4f52ec-441c-4e38-8ab2-613bc54e6ee5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040205 May 11 06:45:27.497720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 353/750] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:27 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:27.825404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:27.826005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:27.831909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.832362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.833121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:27.833553 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:27.958775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:27.967083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:27.968594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:27.969721 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c0f416a8-059f-42db-9eea-1a52e18b4cc7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.149040 May 11 06:45:27.970274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 354/751] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:27 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:45:28.457014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0d79ada0-543a-4728-87ec-f47d336bc51a tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430417 May 11 06:45:28.457781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 398/752] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:45:27 2022] POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments => generated 194 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:28.472181 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:28.472784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:28.479002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.479479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:28.480240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.480666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:28.510428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:28.511459 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:28.517603 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.518056 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:28.518829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.519287 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:28.549897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4ed22349-97c9-4d7b-933f-c6375714c279 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 May 11 06:45:28.550583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 399/753] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:28 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:28.613498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:28.621555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-526f1960-f59d-421f-bc72-a787af111b65 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1521 microversion: 2.1 time: 0.153089 May 11 06:45:28.622119 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 355/754] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:28 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:28.988682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:28.989289 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:28.995567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.996017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:28.996781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:28.997214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.144275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:29.153322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:29.155116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:29.156316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-497a006c-c3e6-4469-8405-c1bfec4602c1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.171526 May 11 06:45:29.167651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 400/755] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:28 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:29.467668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-b31597bd-96cb-4e5a-aed7-08773135324b req-3aaba778-47ae-44f0-83b9-9bfe4c7c030a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915", "name": "network-vif-deleted", "tag": "f96eb40a-ee8f-4854-a24e-26c491a5b3ea"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:29.475527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b31597bd-96cb-4e5a-aed7-08773135324b req-3aaba778-47ae-44f0-83b9-9bfe4c7c030a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.476125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-b31597bd-96cb-4e5a-aed7-08773135324b req-3aaba778-47ae-44f0-83b9-9bfe4c7c030a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.487000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-b31597bd-96cb-4e5a-aed7-08773135324b req-3aaba778-47ae-44f0-83b9-9bfe4c7c030a service nova] Creating event network-vif-deleted:f96eb40a-ee8f-4854-a24e-26c491a5b3ea for instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 on hv-cinder-80475 May 11 06:45:29.492747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-b31597bd-96cb-4e5a-aed7-08773135324b req-3aaba778-47ae-44f0-83b9-9bfe4c7c030a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 May 11 06:45:29.493335 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 356/756] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:29.565942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:29.565942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:29.570568 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.571017 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.571804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.572265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.600529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bd594c1d-bfff-4589-92f2-8422c5a4491f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041740 May 11 06:45:29.601088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 401/757] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:45:29 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:45:29.639377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:29.639911 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:29.646871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.647158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.647955 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.648384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.679200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:29.680073 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:29.688635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.689323 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.689794 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'fault' on Instance uuid acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:29.693627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.694159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.695036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.695559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.722656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:45:29.737115 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:29.745444 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5d60eefd-4edc-410e-a738-7fe0762bdcbf tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1312 microversion: 2.1 time: 0.111010 May 11 06:45:29.746006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 357/758] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:29 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:29.801646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a6a9800e-e664-4c6c-b553-1ff6b822877a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 204 len: 0 microversion: 2.1 time: 0.127660 May 11 06:45:29.802489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 402/759] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:45:29 2022] DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:45:29.810854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:29.811495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:29.817518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.817968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.818745 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:29.819175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:29.948918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:29.957061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5dc537a9-d542-471d-b47a-37fe3e51d0f6 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1681 microversion: 2.1 time: 0.150503 May 11 06:45:29.957741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 358/760] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:29 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:30.175830 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:30.176533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:30.183401 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.183855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.184617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.185055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.310480 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:30.318162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:30.319700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:30.320843 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3480bd86-64ca-4b78-89f1-c713389d3822 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.149382 May 11 06:45:30.321396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 403/761] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:30 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:30.762212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:30.762845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:30.769085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.769527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.770276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.770707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.801143 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.801589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.802034 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'fault' on Instance uuid acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:30.845868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:30.853053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3ee1f63b-68b7-4607-a671-f4a82ba5b390 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1312 microversion: 2.1 time: 0.095153 May 11 06:45:30.853616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 359/762] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:30 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:30.973924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:30.974532 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:30.980432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.980880 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:30.981633 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:30.982083 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.106086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:31.113299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5006f7df-1b4a-4fd5-9a23-e5255eef4684 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1681 microversion: 2.1 time: 0.143288 May 11 06:45:31.113867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 404/763] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:30 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:31.339456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:31.340066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:31.346058 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:31.346516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.347304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:31.347744 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.471685 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:31.479948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:31.481451 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:31.482598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-40c0bde2-3550-40cc-a6c7-2a7485fa6441 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.147133 May 11 06:45:31.483162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 360/764] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:31 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:31.870063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:31.870687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:31.876912 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:31.877358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.878118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:31.878555 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.912363 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:31.912804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:31.913241 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lazy-loading 'fault' on Instance uuid acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:31.956799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334273a56994a7abfa3d72006f7a7a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1689ff62644e0c92c3bf8290b52b90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:31.964022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4668f54c-036b-4b43-b2be-355a4cb825f9 tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 200 len: 1312 microversion: 2.1 time: 0.098283 May 11 06:45:31.964707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 405/765] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:31 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:32.130006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:32.130620 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:32.137598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.138046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.138813 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.139249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.270253 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:32.277513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6790e938-43cf-41e7-ba65-c84bde7bec3d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1681 microversion: 2.1 time: 0.151394 May 11 06:45:32.278081 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 361/766] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:32 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:32.502062 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:32.502657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:32.508401 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.508906 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.509661 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.510691 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.644997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:32.652755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:32.654328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:32.655581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6ba5adcc-220c-45a9-9666-f93f78e5793a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.157708 May 11 06:45:32.656162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 406/767] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:32 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:32.819816 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-e89801ce-7e56-48b9-b4fc-301a336668e3 req-8c87dba4-4527-4293-8d6a-e2e0c886becc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d780cb-2ea7-4645-937d-03eef82ae3c4", "name": "network-vif-deleted", "tag": "46f06357-bb6c-4461-a2f7-c4a89a2e46fe"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:32.828832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e89801ce-7e56-48b9-b4fc-301a336668e3 req-8c87dba4-4527-4293-8d6a-e2e0c886becc service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.829321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e89801ce-7e56-48b9-b4fc-301a336668e3 req-8c87dba4-4527-4293-8d6a-e2e0c886becc service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.842815 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-e89801ce-7e56-48b9-b4fc-301a336668e3 req-8c87dba4-4527-4293-8d6a-e2e0c886becc service nova] Creating event network-vif-deleted:46f06357-bb6c-4461-a2f7-c4a89a2e46fe for instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 on hv-cinder-80475 May 11 06:45:32.848600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-e89801ce-7e56-48b9-b4fc-301a336668e3 req-8c87dba4-4527-4293-8d6a-e2e0c886becc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 May 11 06:45:32.849267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 362/768] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:32.982249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:32.983252 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] [instance: acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:32.993078 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.993526 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:32.994998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:32.999161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.011207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] HTTP exception thrown: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Request method failure captured: May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 HTTP/1.1 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oVFNC3chn7NkOA_8EUeVavAZOmL4jJPOIePeS4PmnZDqh1iOO0IHhqfL8svd_gFAEWel3AClgmqc2APtM42fKrqSpdfT3EC3PAD_F6t86viWoyVXa8Ps7SQnsTQQPz06Z8DhCRcbmuvR9XM4PUckdDLGL_FrY3lZUBl6n3HIZzZA4 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:45:33.012902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d1689ff62644e0c92c3bf8290b52b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 0d1689ff62644e0c92c3bf8290b52b90 May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-447263112 May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 0334273a56994a7abfa3d72006f7a7a4 May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-447263112-project May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. May 11 06:45:33.014611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915'} May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:45:33.015525 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. May 11 06:45:33.017403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:45:33.019904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] Returning 404 to user: Instance acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:45:33.019904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6b037acf-4111-426c-9f08-2399e6bebe9e tempest-ServerRescueNegativeTestJSON-447263112 tempest-ServerRescueNegativeTestJSON-447263112-project] 10.222.0.64 "GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915" status: 404 len: 111 microversion: 2.1 time: 0.037147 May 11 06:45:33.019904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 407/769] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:32 2022] GET /compute/v2.1/servers/acb0b481-fc2c-4ed9-a21c-a1ad9cd3b915 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:45:33.297621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:33.298652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:33.308201 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:33.309008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.310021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:33.310698 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.350198 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:33.350986 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.351474 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lazy-loading 'fault' on Instance uuid 09d780cb-2ea7-4645-937d-03eef82ae3c4 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:45:33.421510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:33.432510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5871ebcd-8128-4645-8708-7b2895e8de8c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 200 len: 1330 microversion: 2.1 time: 0.139838 May 11 06:45:33.441515 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 363/770] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:33 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:33.673884 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:33.674489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:33.680546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:33.680997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.682395 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:33.682826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:33.938602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:33.946356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:33.948683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:33.950190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b20e0aaa-0c7d-4acd-b456-41418bd16216 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.280184 May 11 06:45:33.951041 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 408/771] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:33 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:34.449537 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:34.450240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:34.457187 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:34.457712 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:34.458575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:34.459083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:34.472159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 HTTP/1.1 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:45:34.473913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:45:34.475317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '09d780cb-2ea7-4645-937d-03eef82ae3c4'} May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:45:34.476124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:45:34.477433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:45:34.479064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:45:34.479064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2599e807-ed8b-4102-812f-d0e95afd0897 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 404 len: 111 microversion: 2.1 time: 0.031247 May 11 06:45:34.479064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 364/772] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:34 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:45:34.486403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ab160de3-cd73-48c9-9bb1-7e8bfcc83335 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '.version_select at 0x7fc5c8a3c0d0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:34.503910 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ab160de3-cd73-48c9-9bb1-7e8bfcc83335 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604362191" status: 202 len: 0 microversion: 2.1 time: 0.021223 May 11 06:45:34.504680 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 409/773] 10.222.0.64 () {58 vars in 1217 bytes} [Wed May 11 06:45:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604362191 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:45:34.969248 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:34.969828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:34.976155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:34.976604 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:34.977529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:34.977968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:35.264574 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:35.276642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:35.279233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:35.281559 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-dbfae36e-5592-4eb9-90b3-765154d02bf8 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.316338 May 11 06:45:35.293252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 365/774] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:34 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:35.574094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2327b902-ddfe-4643-a7ad-c180a0d34393 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: .version_select at 0x7fc5c8aa9430>, body: {"keypair": {"name": "tempest-keypair-140120323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEMA+PjevixH5wnm9L6rXgx/kyPhlHi8yXoBJAdl1/KOTtlYtOBbl8k+FcwMJ50h478lLjtmY6QWwffJmuUCerPDAzgR+Th+e56enoAHnqA82I5GqxY9e3oEKtzH9jR5g=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:35.592261 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-2327b902-ddfe-4643-a7ad-c180a0d34393 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:35.601140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-2327b902-ddfe-4643-a7ad-c180a0d34393 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:35.631720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2327b902-ddfe-4643-a7ad-c180a0d34393 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061919 May 11 06:45:35.632795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 410/775] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:45:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:36.301151 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:36.301804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:36.309583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:36.310086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:36.310862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:36.311312 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:36.465216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:36.473984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:36.475545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:36.476788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6f130e85-ba03-4842-9a38-ad8728e18794 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.179578 May 11 06:45:36.477346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 366/776] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:36 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:37.501227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:37.502942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:37.510141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:37.510833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:37.511621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:37.512203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:37.531382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924229466", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61e699df-3755-47eb-b019-c5436429fdb7"}], "security_groups": [{"name": "tempest-securitygroup--1225726174"}], "key_name": "tempest-keypair-140120323", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:37.671372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] validate_networks() for [('61e699df-3755-47eb-b019-c5436429fdb7', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:45:37.680507 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:37.689439 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:37.690942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:37.692118 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-eb8580d2-3fc1-41e2-acb2-5228ee8771b4 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.199460 May 11 06:45:37.703318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 411/777] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:37 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:45:38.195141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:38.195141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:38.210412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.211801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.212602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.213090 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.346927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:45:38.347373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:45:38.347851 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:45:38.348258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:45:38.348670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:45:38.358106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.358332 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.359133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.359616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.378128 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:38.382479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Getting quotas for user e57cd656669e42bea86c8206b333bd6d and project eb4348f294cc464f89b2334676442d25. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:38.385357 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:38.393639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8d85041b-1979-4741-a0ba-adfe5a3de5b1 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1593 microversion: 2.1 time: 0.203922 May 11 06:45:38.393901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:45:38.394282 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 412/778] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:38 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1593 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:38.396598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:45:38.456259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0abc5217-1c04-4089-b6c6-41c30caee938 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.928977 May 11 06:45:38.462022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 367/779] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:45:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:45:38.468189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a165d782-311c-478b-9576-6a1869f7a080 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:38.468801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a165d782-311c-478b-9576-6a1869f7a080 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:38.541036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a165d782-311c-478b-9576-6a1869f7a080 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:38.547486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a165d782-311c-478b-9576-6a1869f7a080 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1241 microversion: 2.1 time: 0.084298 May 11 06:45:38.548052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 413/780] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:38 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:38.712418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:38.720054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:38.733718 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.734166 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.734988 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:38.735512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:38.985961 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:38.995917 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:38.999466 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:39.000915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-dda1fd2d-14df-472a-b607-229556ff80b1 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.293342 May 11 06:45:39.002087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 368/781] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:38 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:39.563787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:39.564404 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:39.571348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:39.572903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:39.574305 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:39.574970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:39.677509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:39.685651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-59bd6dc6-f082-4f6c-a1d8-8b37b9246b7c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1293 microversion: 2.1 time: 0.125575 May 11 06:45:39.695346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 414/782] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:39 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:40.023449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:40.025819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:40.033788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:40.034268 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:40.035473 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:40.036380 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:40.299952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:40.309540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:40.311519 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:40.313334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-dee2d0f2-258f-4cc5-92bc-44d37ef214ec tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.296162 May 11 06:45:40.314068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 369/783] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:40 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:40.704572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:40.706170 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:40.715050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:40.715915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:40.716979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:40.718147 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:41.015759 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:41.024268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6a2b7fbc-9043-4591-ad66-26768f512d6e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1299 microversion: 2.1 time: 0.324285 May 11 06:45:41.038273 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 415/784] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:40 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1299 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:41.153454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-6718f71e-0d59-40a2-9813-06597f72b8f7 req-8ef9d868-2513-4234-9e47-4adbf49c25b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:41.164287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-6718f71e-0d59-40a2-9813-06597f72b8f7 req-8ef9d868-2513-4234-9e47-4adbf49c25b6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:41.164899 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-6718f71e-0d59-40a2-9813-06597f72b8f7 req-8ef9d868-2513-4234-9e47-4adbf49c25b6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:41.206595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-6718f71e-0d59-40a2-9813-06597f72b8f7 req-8ef9d868-2513-4234-9e47-4adbf49c25b6 service nova] Creating event network-changed:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:45:41.218422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-6718f71e-0d59-40a2-9813-06597f72b8f7 req-8ef9d868-2513-4234-9e47-4adbf49c25b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069278 May 11 06:45:41.219652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 370/785] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:41.339871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:41.341209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:41.374380 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:41.375360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:41.377205 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:41.377936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:41.692034 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:41.704337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:41.707833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:41.713221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-28fc77b1-8c7d-4349-9a86-7e3ba8682819 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1745 microversion: 2.20 time: 0.384763 May 11 06:45:41.714043 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 416/786] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:41 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1745 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:42.042868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:42.043769 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:42.052202 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:42.053047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:42.054081 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:42.054886 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:42.346499 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:42.356512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5f62846a-c0b7-4dcd-8bda-b655cde41fe2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.318960 May 11 06:45:42.357334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 371/787] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:42 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:42.735300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:42.735971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:42.752076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:42.752534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:42.760097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:42.760691 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:43.075790 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-e2974b0e-1754-4795-b230-0c7816b67788 req-5f8425a1-9eb3-4901-b9fb-731a44241408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4191b4-a818-4c0f-95ee-869fd30177e2", "tag": "7970ee38-ee7c-48dd-b7d9-3efd0916a387"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:43.096808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e2974b0e-1754-4795-b230-0c7816b67788 req-5f8425a1-9eb3-4901-b9fb-731a44241408 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:43.097249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e2974b0e-1754-4795-b230-0c7816b67788 req-5f8425a1-9eb3-4901-b9fb-731a44241408 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:43.108577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-e2974b0e-1754-4795-b230-0c7816b67788 req-5f8425a1-9eb3-4901-b9fb-731a44241408 service nova] Creating event network-changed:7970ee38-ee7c-48dd-b7d9-3efd0916a387 for instance ef4191b4-a818-4c0f-95ee-869fd30177e2 on hv-cinder-80475 May 11 06:45:43.123897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-e2974b0e-1754-4795-b230-0c7816b67788 req-5f8425a1-9eb3-4901-b9fb-731a44241408 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049944 May 11 06:45:43.124786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 372/788] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:43.221344 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:43.231909 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:43.233778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:43.235355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-94f3dabb-2907-4ad2-a971-95fa1b9a7412 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1745 microversion: 2.20 time: 0.504739 May 11 06:45:43.236159 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 417/789] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:42 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1745 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:43.374281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:43.375830 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:43.383189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:43.384002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:43.385543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:43.386303 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:43.763726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:43.772041 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-78ecc6ff-f468-463e-97c0-e0fec0e02b43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.402955 May 11 06:45:43.783725 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 373/790] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:43 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:43.886304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-963399563"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:43.887535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:43.895349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:43.896005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:43.896963 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:43.897579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:44.173546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.network.security_group_api [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Adding security group 7997d7bc-cf0c-4955-aaac-0e43a6dee0e4 to port c252b84e-76c5-4079-b1f3-11dd833563b3 May 11 06:45:44.254121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:44.254658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:44.261789 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:44.262387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:44.263176 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:44.263719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:44.572984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:44.586453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:44.588676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:44.590078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c4960f70-6472-4e87-be1f-ef60fa9a9737 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.340050 May 11 06:45:44.601985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 374/791] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:44 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:45:44.601985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-bc8dd985-a0c3-499e-9bfe-ee4ac2169cb4 req-262f5f58-ad12-4d55-9449-301818df6cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "name": "network-vif-plugged", "status": "completed", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:44.604118 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-bc8dd985-a0c3-499e-9bfe-ee4ac2169cb4 req-262f5f58-ad12-4d55-9449-301818df6cc0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:44.604555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-bc8dd985-a0c3-499e-9bfe-ee4ac2169cb4 req-262f5f58-ad12-4d55-9449-301818df6cc0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:44.617821 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-bc8dd985-a0c3-499e-9bfe-ee4ac2169cb4 req-262f5f58-ad12-4d55-9449-301818df6cc0 service nova] Creating event network-vif-plugged:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:45:44.626809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-bc8dd985-a0c3-499e-9bfe-ee4ac2169cb4 req-262f5f58-ad12-4d55-9449-301818df6cc0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 May 11 06:45:44.627672 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 375/792] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:44.791808 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:44.792603 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:44.805981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:44.807011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:44.809267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:44.810900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:45.493080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ce5f7e8e-8a8b-4fff-bf90-69a72c2c705d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action" status: 202 len: 0 microversion: 2.1 time: 1.610710 May 11 06:45:45.499958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 418/793] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:45:43 2022] POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action => generated 0 bytes in 1618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:45:45.523854 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:45.524573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:45.546237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:45.546994 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:45.548037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:45.549756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:45.678616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:45.694381 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8a196c3b-9c73-4762-b32c-72119d0dd564 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.907411 May 11 06:45:45.699786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 376/794] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:44 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:45.707500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-ff632413-7716-44d6-a620-b616396dbd77 req-f2cb40ba-e353-41a9-933f-40b7c4456ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:45.726520 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-ff632413-7716-44d6-a620-b616396dbd77 req-f2cb40ba-e353-41a9-933f-40b7c4456ea0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:45.729840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-ff632413-7716-44d6-a620-b616396dbd77 req-f2cb40ba-e353-41a9-933f-40b7c4456ea0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:45.756312 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-ff632413-7716-44d6-a620-b616396dbd77 req-f2cb40ba-e353-41a9-933f-40b7c4456ea0 service nova] Creating event network-changed:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:45:45.765008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-ff632413-7716-44d6-a620-b616396dbd77 req-f2cb40ba-e353-41a9-933f-40b7c4456ea0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061510 May 11 06:45:45.766013 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 377/795] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:45.772505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:45.773592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:45.784733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:45.787394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:45.791452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:45.813244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:46.173896 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:46.184819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-43f5191a-ba0f-4af7-bb45-923ba93b3eaf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1757 microversion: 2.1 time: 0.674706 May 11 06:45:46.198435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 419/796] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:45 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1757 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:46.250810 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:46.264061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:46.266097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:46.267848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e308a1b3-5281-4ad1-9773-c9590e33021d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.500309 May 11 06:45:46.268978 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 378/797] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:45 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:46.715805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:46.716523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:46.728164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:46.736584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:46.739254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:46.739922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:46.892581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ea5e5934-8794-465a-8035-be619c17503f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: .version_select at 0x7fc5c8a0c280>, body: {"keypair": {"name": "tempest-keypair-1973683960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1xEceEsL0dW2m9ejSPcnpJL4qKr+SGOtgjGbVa84c0XiPV0+aSFn8KTDJCFITzc/GXJhyl7/k57aqw5YYbVSIMNg8VRkLIBNi/ylu8p3VYWepfmwckd5+85ZWdC83HzA=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:46.915235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-ea5e5934-8794-465a-8035-be619c17503f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for project ec5def7947c243698109bfc891b0992f. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:46.926086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-ea5e5934-8794-465a-8035-be619c17503f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for user 4974777a05b64dbcb3550b74b9f39dee and project ec5def7947c243698109bfc891b0992f. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:46.966727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ea5e5934-8794-465a-8035-be619c17503f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270352 May 11 06:45:46.968095 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 420/798] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:45:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:47.027824 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:47.044131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2a814ae0-e26a-4417-90bf-a0c8e29e1990 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.332251 May 11 06:45:47.045359 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 379/799] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:46 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:47.294044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:47.294667 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:47.318778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:47.320102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:47.322757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:47.325569 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:47.622426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:47.632327 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:47.636636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:47.640587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d9c83ef5-9dbf-45dd-9ee8-11e9fd585204 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.357030 May 11 06:45:47.641368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 421/800] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:47 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:48.063498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:48.064785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:48.073735 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:48.074456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:48.075842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:48.076450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:48.324626 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:48.333527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c6f6279a-3857-4ca6-85c1-c8caadecb3e7 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.275568 May 11 06:45:48.345922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 380/801] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:48 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:48.659326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:48.660328 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:48.669165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:48.669391 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:48.670155 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:48.670597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:48.948979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:48.965699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:48.967620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:48.969195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa274400-8841-472b-ab46-a4412c57244b tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.313858 May 11 06:45:48.969962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 422/802] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:48 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:49.160064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-508244955", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6742b34a-d638-418c-8bcb-aa221cf053c2"}], "security_groups": [{"name": "tempest-securitygroup--1577923438"}], "key_name": "tempest-keypair-1973683960", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:49.296213 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] validate_networks() for [('6742b34a-d638-418c-8bcb-aa221cf053c2', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:45:49.352625 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:49.354140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:49.363092 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:49.364117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:49.365122 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:49.365727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:49.646617 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:49.655293 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b7918965-1591-45a4-9515-f61832b87c43 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.306403 May 11 06:45:49.664189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 423/803] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:49 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:45:49.905217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:45:49.905802 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:45:49.906380 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:45:49.906907 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:45:49.907461 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:45:49.918696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:49.919492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:49.920508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:49.921109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:49.964184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for project ec5def7947c243698109bfc891b0992f. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:45:49.970182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for user 4974777a05b64dbcb3550b74b9f39dee and project ec5def7947c243698109bfc891b0992f. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:45:49.984677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:45:49.988474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:49.992026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:49.999950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:45:50.027031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:50.030351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:50.032688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:50.057333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:50.101125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2eb96986-9256-4f15-9314-a11119a73786 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.945446 May 11 06:45:50.113093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 381/804] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:45:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:45:50.124691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b1870dd8-d667-4585-be10-326f332c36d7 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:50.138398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b1870dd8-d667-4585-be10-326f332c36d7 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:50.285381 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b1870dd8-d667-4585-be10-326f332c36d7 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:50.297584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b1870dd8-d667-4585-be10-326f332c36d7 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1237 microversion: 2.1 time: 0.181452 May 11 06:45:50.298731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 382/805] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:50 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:50.398218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:50.411383 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:50.413952 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:50.421737 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-884a995a-a6f6-4aad-b991-a2f0a6aa9a5d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.437114 May 11 06:45:50.429022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 424/806] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:49 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:50.681893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:50.682965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:50.691703 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-b039a769-0379-4f17-ace9-c7547caf36b8 req-b6166fd1-7ba9-4e55-8219-298bb2729e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4191b4-a818-4c0f-95ee-869fd30177e2", "name": "network-vif-plugged", "status": "completed", "tag": "7970ee38-ee7c-48dd-b7d9-3efd0916a387"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:50.701736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:50.703079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:50.703599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b039a769-0379-4f17-ace9-c7547caf36b8 req-b6166fd1-7ba9-4e55-8219-298bb2729e28 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:50.704048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b039a769-0379-4f17-ace9-c7547caf36b8 req-b6166fd1-7ba9-4e55-8219-298bb2729e28 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:50.705262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:50.706373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:50.733709 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-b039a769-0379-4f17-ace9-c7547caf36b8 req-b6166fd1-7ba9-4e55-8219-298bb2729e28 service nova] Creating event network-vif-plugged:7970ee38-ee7c-48dd-b7d9-3efd0916a387 for instance ef4191b4-a818-4c0f-95ee-869fd30177e2 on hv-cinder-80475 May 11 06:45:50.742819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-b039a769-0379-4f17-ace9-c7547caf36b8 req-b6166fd1-7ba9-4e55-8219-298bb2729e28 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056203 May 11 06:45:50.749321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 425/807] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:50.994566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:51.005318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-82fd7878-a560-4e1e-9012-d9249717ef89 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.334018 May 11 06:45:51.008710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 383/808] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:50 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:51.315907 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:51.316996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:51.323961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:51.324419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:51.325195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:51.325631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:51.401869 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:51.415939 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a8b76411-7a1c-4bc2-a76f-54dc8c54d629 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1289 microversion: 2.1 time: 0.103042 May 11 06:45:51.418879 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 426/809] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:51 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:51.447600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:51.448561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:51.455310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:51.456007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:51.457009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:51.457509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:51.597750 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:51.606765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:51.608791 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:51.610179 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0d3c5008-5508-43fe-bb05-340b188dca7f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.166741 May 11 06:45:51.610739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 384/810] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:51 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:52.023777 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:52.025588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:52.037819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.038329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.039357 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.039821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.238299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:52.272757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-708ffd88-05c0-41d0-9b6e-22941d69bb9e tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1367 microversion: 2.1 time: 0.252934 May 11 06:45:52.277529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 427/811] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:52 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:52.438184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:52.438805 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:52.445352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.446149 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.447801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.449095 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.522315 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:52.530591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-aa257bc9-8118-4258-9360-388b202cb4ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1295 microversion: 2.1 time: 0.096437 May 11 06:45:52.531163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 385/812] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:52 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:52.629693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:52.632141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:52.644697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.645128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.646111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:52.646702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:52.825650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:52.840818 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:52.842322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:52.843768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-56af9ad9-c7c3-4b73-9565-cb1d20ef9997 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.217785 May 11 06:45:52.844421 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 428/813] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:52 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:45:53.303833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:53.304647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:53.315186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.318229 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.319109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.322496 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.512887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:53.521493 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6d85de39-6546-42ec-b293-a697ebdf9326 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1557 microversion: 2.1 time: 0.230880 May 11 06:45:53.527326 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 386/814] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:53 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:53.541051 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:53.542496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:53.554067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.554520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.555162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:53.555841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:53.558919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.559529 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.567252 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.570848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.573981 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.574435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.698102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-295bb1d7-4858-4329-abfa-c1b857f74b54 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163771 May 11 06:45:53.698971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 429/815] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:45:53 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:53.801622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:53.817809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b31e99e3-125b-456e-9ecf-f48ea359b82a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.271717 May 11 06:45:53.818764 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 387/816] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:53 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:53.863088 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:53.863976 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:53.870908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.873131 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:53.875127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:53.876815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:54.048142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:54.060971 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:54.063435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:54.064641 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f2973e85-387c-4a7d-9f7c-79ad7b9e248d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.206626 May 11 06:45:54.065213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 430/817] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:53 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:54.838949 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:54.841216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:54.848825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:54.849688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:54.850729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:54.851455 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:55.011772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:55.021887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-240a6e0c-7950-4bae-97ce-9dbb08275603 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.189843 May 11 06:45:55.023145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 388/818] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:54 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:55.089699 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:55.092242 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:55.100373 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:55.100841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:55.101689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:55.103687 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:55.175042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-0d6c6191-23f2-4076-9f75-1264ebd32673 req-b58ee67a-6dd7-4a18-b6f6-6cbd980aa492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319d4a2d-cf16-4a05-824b-f0e457578c58", "tag": "3abf2078-858c-4ccf-a7cb-d16309a1b893"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:55.198604 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0d6c6191-23f2-4076-9f75-1264ebd32673 req-b58ee67a-6dd7-4a18-b6f6-6cbd980aa492 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:55.199489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0d6c6191-23f2-4076-9f75-1264ebd32673 req-b58ee67a-6dd7-4a18-b6f6-6cbd980aa492 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:55.237153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-0d6c6191-23f2-4076-9f75-1264ebd32673 req-b58ee67a-6dd7-4a18-b6f6-6cbd980aa492 service nova] Creating event network-changed:3abf2078-858c-4ccf-a7cb-d16309a1b893 for instance 319d4a2d-cf16-4a05-824b-f0e457578c58 on hv-cinder-80475 May 11 06:45:55.248728 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-0d6c6191-23f2-4076-9f75-1264ebd32673 req-b58ee67a-6dd7-4a18-b6f6-6cbd980aa492 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078468 May 11 06:45:55.252172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 389/819] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:45:55.359668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:55.373771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:55.375340 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:55.376458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-be34efee-4dcf-472d-868e-9ba34a3c7dc9 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.296958 May 11 06:45:55.379975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 431/820] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:55 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:56.041544 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:56.042487 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:56.048757 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:56.049429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:56.050201 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:56.050796 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:56.206896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:56.216021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7315d58a-4962-4f71-aac2-6a786564b88e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.179367 May 11 06:45:56.216883 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 390/821] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:56 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:56.415342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:56.415342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:56.417600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:56.418066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:56.419163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:56.419639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:56.627407 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:56.652885 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:56.655148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:56.657405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3164e452-385f-40ee-9eda-48198c4d8af7 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.253874 May 11 06:45:56.658875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 432/822] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:56 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:57.234292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:57.234914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:57.241532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:57.242243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:57.244521 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:57.245224 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:57.277970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-89d7d067-25ef-455e-a719-a315979ff0c9 req-710ee431-1626-40fc-9a82-f6eeb34a99a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4191b4-a818-4c0f-95ee-869fd30177e2", "tag": "7970ee38-ee7c-48dd-b7d9-3efd0916a387"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:45:57.290975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-89d7d067-25ef-455e-a719-a315979ff0c9 req-710ee431-1626-40fc-9a82-f6eeb34a99a3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:57.294606 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-89d7d067-25ef-455e-a719-a315979ff0c9 req-710ee431-1626-40fc-9a82-f6eeb34a99a3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:57.338822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-89d7d067-25ef-455e-a719-a315979ff0c9 req-710ee431-1626-40fc-9a82-f6eeb34a99a3 service nova] Creating event network-changed:7970ee38-ee7c-48dd-b7d9-3efd0916a387 for instance ef4191b4-a818-4c0f-95ee-869fd30177e2 on hv-cinder-80475 May 11 06:45:57.352720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-89d7d067-25ef-455e-a719-a315979ff0c9 req-710ee431-1626-40fc-9a82-f6eeb34a99a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078860 May 11 06:45:57.353918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 433/823] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:45:57.479451 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:57.487178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b692236c-1620-4ee9-9c9a-f57d75cc2a48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.256967 May 11 06:45:57.499365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 391/824] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:57 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:57.685731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:57.686376 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:57.692878 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:57.693332 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:57.694102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:57.694538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:57.858724 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:57.866561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:57.868067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:57.869774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a3566074-3f86-4dc2-9e79-f52bb6688b69 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1740 microversion: 2.20 time: 0.189028 May 11 06:45:57.870326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 434/825] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:57 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:58.504472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:58.505165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:58.512336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:58.512864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:58.513707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:58.514211 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:58.646022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:58.654080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ad06a465-0c18-4b40-8be4-b72e8167e9bc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.153372 May 11 06:45:58.654662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 392/826] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:58 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:45:58.889326 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:58.889938 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:58.896519 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:58.896970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:58.897737 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:58.898174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:59.029434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:59.037651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:59.039230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:59.040988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-756ecd39-2723-42ea-bd15-ef688c63d068 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1722 microversion: 2.20 time: 0.155344 May 11 06:45:59.041546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 435/827] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:45:58 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:45:59.671403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:45:59.672046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:45:59.678340 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:59.678786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:59.679580 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:45:59.680015 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:45:59.806912 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:45:59.814123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-63b86bcb-0999-414f-90d6-93362f56522a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.146582 May 11 06:45:59.814708 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 393/828] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:45:59 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:00.059413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:00.060020 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:00.066234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:00.066679 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:00.067483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:00.067916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:00.197286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:00.205196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:00.206716 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:00.207887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2b60e553-a7e7-4400-bf7b-f88d6f8cd749 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1722 microversion: 2.20 time: 0.152401 May 11 06:46:00.208447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 436/829] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:00 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:00.420820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-24a5a329-411a-462f-8eff-5b892955eb0b req-89c00c04-cce2-4543-8abd-1dcb3bb2c7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319d4a2d-cf16-4a05-824b-f0e457578c58", "name": "network-vif-plugged", "status": "completed", "tag": "3abf2078-858c-4ccf-a7cb-d16309a1b893"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:00.428993 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-24a5a329-411a-462f-8eff-5b892955eb0b req-89c00c04-cce2-4543-8abd-1dcb3bb2c7f3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:00.429409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-24a5a329-411a-462f-8eff-5b892955eb0b req-89c00c04-cce2-4543-8abd-1dcb3bb2c7f3 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:00.440909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-24a5a329-411a-462f-8eff-5b892955eb0b req-89c00c04-cce2-4543-8abd-1dcb3bb2c7f3 service nova] Creating event network-vif-plugged:3abf2078-858c-4ccf-a7cb-d16309a1b893 for instance 319d4a2d-cf16-4a05-824b-f0e457578c58 on hv-cinder-80475 May 11 06:46:00.445951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-24a5a329-411a-462f-8eff-5b892955eb0b req-89c00c04-cce2-4543-8abd-1dcb3bb2c7f3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028881 May 11 06:46:00.447096 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 394/830] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:00.832066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:00.833171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:00.840720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:00.841165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:00.841937 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:00.842366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:00.980717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:00.987982 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-09fd41b1-08f3-4206-a34e-15f71208153e tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.160110 May 11 06:46:00.988554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 437/831] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:00 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:01.227214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:01.228630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:01.234937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.235425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:01.236196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.236633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:01.365798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:01.373523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:01.375039 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:01.376214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a7ecbc96-f9ed-470a-828d-61b444d5521a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1725 microversion: 2.20 time: 0.153883 May 11 06:46:01.376778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 395/832] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:01 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:01.394411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ae1a32-2324-4ff8-bc29-e6ed7e26b50b"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:01.395557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:01.402505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.402957 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:01.403744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.404178 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:01.655698 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8fa9a245-362d-4186-be77-5bea9e124bf0 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.265224 May 11 06:46:01.656307 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 438/833] 10.222.0.64 () {62 vars in 1363 bytes} [Wed May 11 06:46:01 2022] POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments => generated 188 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:46:01.770193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:01.770691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:01.776525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.776974 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:01.777740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:01.778182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.004903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:02.005604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:02.013637 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.014175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.015194 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.015838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.019514 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3bbd6a7d-f2af-4d7d-ac08-591674ece123 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments/05ae1a32-2324-4ff8-bc29-e6ed7e26b50b" status: 202 len: 0 microversion: 2.20 time: 0.253095 May 11 06:46:02.020240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 396/834] 10.222.0.64 () {60 vars in 1456 bytes} [Wed May 11 06:46:01 2022] DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments/05ae1a32-2324-4ff8-bc29-e6ed7e26b50b => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:46:02.076524 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:02.077092 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:02.083043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.083545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.084336 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.084748 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.148334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:02.155962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0aa2c420-a049-4d8e-9b13-ab05fd662353 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1363 microversion: 2.1 time: 0.154984 May 11 06:46:02.156533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 439/835] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:01 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:02.162107 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b8f342ad-978e-4239-b91b-b2b352b471bb tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/action" status: 202 len: 0 microversion: 2.20 time: 0.089719 May 11 06:46:02.162699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 397/836] 10.222.0.64 () {62 vars in 1318 bytes} [Wed May 11 06:46:02 2022] POST /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 06:46:02.172027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:02.172725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:02.178618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.179070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.179855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.180291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.314915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:02.323615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:02.325120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:02.326272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-21393876-03f1-45f7-ba07-687c5e832d12 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1673 microversion: 2.20 time: 0.158145 May 11 06:46:02.327209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 440/837] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:02 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:02.481469 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-82be8863-0fce-4f4d-ab08-10459ecc8309 req-d1217a62-b1fe-4506-8b5e-985bd0661706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "name": "network-vif-unplugged", "status": "completed", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:02.489853 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-82be8863-0fce-4f4d-ab08-10459ecc8309 req-d1217a62-b1fe-4506-8b5e-985bd0661706 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:02.490255 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-82be8863-0fce-4f4d-ab08-10459ecc8309 req-d1217a62-b1fe-4506-8b5e-985bd0661706 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:02.501621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.compute.server_external_events [req-82be8863-0fce-4f4d-ab08-10459ecc8309 req-d1217a62-b1fe-4506-8b5e-985bd0661706 service nova] Unable to find a host for instance 596cbeb7-7356-4919-913a-a0adace78883. Dropping event network-vif-unplugged {{(pid=128923) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 06:46:02.502494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-82be8863-0fce-4f4d-ab08-10459ecc8309 req-d1217a62-b1fe-4506-8b5e-985bd0661706 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024951 May 11 06:46:02.503077 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 398/838] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 06:46:03.173260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:03.173874 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:03.180534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.180998 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.182375 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.182809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.311095 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:03.318398 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bd81be33-90c2-4240-8f59-a4b7069afe05 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1549 microversion: 2.1 time: 0.148946 May 11 06:46:03.318961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 441/839] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:03 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:03.335427 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:03.335976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:03.341908 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.342361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.343121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.343624 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.343860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:03.344487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:03.350220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.350679 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.351448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:03.351878 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:03.450687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-568e9065-eacf-4c04-bd0f-4abc3e6fa9dc tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119125 May 11 06:46:03.451298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 399/840] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:46:03 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:03.511256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:03.520790 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:03.523305 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:03.525393 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ac8928f5-beb8-4e22-942a-16cecbc6b021 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1673 microversion: 2.20 time: 0.185292 May 11 06:46:03.526050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 442/841] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:03 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:04.449411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-e5e0a2da-53aa-4d33-9d36-a90b2efe44f9 req-5cb2d846-fef6-4475-9145-b9df0b88eddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319d4a2d-cf16-4a05-824b-f0e457578c58", "tag": "3abf2078-858c-4ccf-a7cb-d16309a1b893"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:04.457492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e5e0a2da-53aa-4d33-9d36-a90b2efe44f9 req-5cb2d846-fef6-4475-9145-b9df0b88eddb service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:04.457936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-e5e0a2da-53aa-4d33-9d36-a90b2efe44f9 req-5cb2d846-fef6-4475-9145-b9df0b88eddb service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:04.468888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-e5e0a2da-53aa-4d33-9d36-a90b2efe44f9 req-5cb2d846-fef6-4475-9145-b9df0b88eddb service nova] Creating event network-changed:3abf2078-858c-4ccf-a7cb-d16309a1b893 for instance 319d4a2d-cf16-4a05-824b-f0e457578c58 on hv-cinder-80475 May 11 06:46:04.473976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-e5e0a2da-53aa-4d33-9d36-a90b2efe44f9 req-5cb2d846-fef6-4475-9145-b9df0b88eddb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028915 May 11 06:46:04.474816 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 400/842] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:46:04.546235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:04.546857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:04.553139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:04.553656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:04.554418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:04.555496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:04.768586 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:04.777481 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:04.778966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:04.780438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8c208d35-671c-432f-9036-7c1767f7d548 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.238105 May 11 06:46:04.792516 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 443/843] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:04 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:05.800363 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:05.801064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:05.819225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:05.819656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:05.820446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:05.820886 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:06.042433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:06.050565 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:06.052100 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:06.053462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ad916564-1307-429f-8199-01d3265a4ba2 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.257347 May 11 06:46:06.054186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 401/844] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:05 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:07.072890 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:07.074044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:07.080670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:07.081116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:07.081909 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:07.082334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:07.215594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:07.223663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:07.225175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:07.226320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dde6b910-dc99-41a8-8aaf-42e2ee553b65 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.157529 May 11 06:46:07.226883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 444/845] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:07 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:08.020799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:08.023060 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:08.030843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.031495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.032497 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.033038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.108610 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-18020e2d-d33e-45c9-9769-4154bdf502be tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action" status: 202 len: 0 microversion: 2.1 time: 0.092013 May 11 06:46:08.110799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 402/846] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:46:08 2022] POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:46:08.118146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:08.119018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:08.126675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.127230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.128044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.128487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.246885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:08.247611 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:08.253782 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.254230 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.255022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:08.255488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:08.285689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:08.293827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-47def0a2-5ea5-4034-b3ac-1471812f02ca tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.180309 May 11 06:46:08.297795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 445/847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:08 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:08.395234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:08.404324 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:08.406778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:08.408555 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7556c280-2e0e-479b-b57d-d27d808fc00c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.165880 May 11 06:46:08.409114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 403/848] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:08 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:09.313876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:09.314597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:09.321163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:09.321657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:09.323061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:09.323778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:09.435031 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:09.435662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:09.441577 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:09.442025 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:09.442781 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:09.443416 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:09.472658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:09.481252 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-29dbead2-0470-4150-836d-20560fc52cac tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.171102 May 11 06:46:09.481849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 446/849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:09 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:09.589361 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:09.597682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:09.599192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:09.600395 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e4b30fd3-c9c0-44f3-ac4e-fc4ca4a1116f tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.169689 May 11 06:46:09.601000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 404/850] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:09 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:10.497886 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:10.498478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:10.504782 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:10.505239 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:10.505992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:10.506427 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:10.621311 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:10.622105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:10.629135 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:10.629589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:10.630371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:10.630840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:10.674803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:10.685313 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f2bd9913-aabc-4e9a-aaf6-8eebe5d9de97 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.191031 May 11 06:46:10.685811 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 447/851] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:10 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:10.777445 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:10.785433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:10.786932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:10.788104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9c967efc-f64a-4bc0-a6fa-439db24a13fd tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.174103 May 11 06:46:10.788661 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 405/852] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:10 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:11.704397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:11.704997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:11.712366 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:11.712878 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:11.713645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:11.714175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:11.808164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:11.809283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:11.818137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:11.818137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:11.818137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:11.818137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:11.875533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:11.883735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6080c077-0c28-41cc-b056-9ae3578cc474 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.183264 May 11 06:46:11.884726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 448/853] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:11 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:11.965062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:11.973259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:11.974768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:11.975948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-65589da9-850e-496d-9e3b-78f7a5b0c31d tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.172331 May 11 06:46:11.976693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 406/854] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:11 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:12.901109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:12.901731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:12.908188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:12.908645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:12.909422 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:12.909862 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:12.994424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:12.995249 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:13.001724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:13.002258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:13.003048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:13.004357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:13.391872 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:13.396196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:13.404954 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:13.406549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d99471f3-5274-4eab-88f5-28c595833cbb tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.504792 May 11 06:46:13.407323 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 449/855] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:12 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:13.408776 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:13.409964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-88bef65b-655f-4973-8f7f-64a9655cc170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.419933 May 11 06:46:13.410666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 407/856] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:12 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:14.428853 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:14.428853 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:14.430032 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:14.430032 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:14.433868 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:14.434321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:14.434441 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:14.434891 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:14.435096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:14.435683 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:14.435798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:14.436116 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:14.678250 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:14.681696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:14.686363 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-67ded6a1-a6ee-4a60-b135-1b04ba2591ec tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.266035 May 11 06:46:14.687027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 450/857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:14 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:14.691585 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:14.693287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:14.694558 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-09769f7a-e7f0-4b78-aa5f-4639272a738a tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.270920 May 11 06:46:14.695522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 408/858] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:14 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:15.704471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:15.705015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:15.711821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:15.712266 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:15.712837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:15.713268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:15.713439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:15.713550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:15.719208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:15.719674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:15.720432 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:15.720864 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:15.910085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:15.918441 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:15.919013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:15.920122 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:15.921281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b4a4776e-b175-4fc5-be05-089b078644cf tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.212346 May 11 06:46:15.921837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 409/859] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:15 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:46:15.927016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-966bc08b-179d-46e5-bd37-cb7bfd12a69c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.226495 May 11 06:46:15.927623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 451/860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:15 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:16.939536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:16.940152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:16.944400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:16.945267 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:16.946482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:16.946932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:16.947738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:16.948436 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:16.951987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:16.952430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:16.953403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:16.954180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:17.215067 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:17.222801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:17.224366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:17.225545 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4eeb3fa3-396f-498b-bcae-d62b7c791750 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.289983 May 11 06:46:17.226113 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 410/861] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:16 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:17.252172 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:17.259977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a6a9b5cf-fdbd-449f-86f7-574b66bdd12e tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1749 microversion: 2.1 time: 0.319756 May 11 06:46:17.260548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 452/862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:16 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1749 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:18.244949 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:18.245542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:18.251898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:18.252339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:18.253085 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:18.253512 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:18.276954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:18.277554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:18.283735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:18.284177 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:18.284932 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:18.285361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:18.441894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:18.450779 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:18.452442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:18.453676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f76057a0-6fca-422d-8a12-19e76c94de51 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.213060 May 11 06:46:18.454322 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 411/863] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:18 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:18.471392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:18.479174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ff6a2a51-a6ed-4a53-986e-3672e13a6bcc tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.205979 May 11 06:46:18.479944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 453/864] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:18 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:19.472264 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:19.472867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:19.479148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:19.479619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:19.480370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:19.480797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:19.496624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:19.497256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:19.503446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:19.503898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:19.504661 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:19.505094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:19.681663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:19.689347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:19.690838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:19.692001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-43b65681-570d-4ba0-a2c4-70b2aa465754 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.223679 May 11 06:46:19.692732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 412/865] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:19 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:19.695974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:19.704502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-256cbef9-8eb8-48fb-b0b9-e5cae6853ec3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.211729 May 11 06:46:19.705066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 454/866] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:19 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:20.551180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-88be755c-0493-4237-8c48-bfa71b0ddfea req-3a973db2-f5d1-4131-b6cd-c74aa9813d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "name": "network-vif-plugged", "status": "completed", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:20.561091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-88be755c-0493-4237-8c48-bfa71b0ddfea req-3a973db2-f5d1-4131-b6cd-c74aa9813d0a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:20.561838 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-88be755c-0493-4237-8c48-bfa71b0ddfea req-3a973db2-f5d1-4131-b6cd-c74aa9813d0a service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:20.574869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-88be755c-0493-4237-8c48-bfa71b0ddfea req-3a973db2-f5d1-4131-b6cd-c74aa9813d0a service nova] Creating event network-vif-plugged:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:46:20.579962 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-88be755c-0493-4237-8c48-bfa71b0ddfea req-3a973db2-f5d1-4131-b6cd-c74aa9813d0a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 May 11 06:46:20.580635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 413/867] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:20.712044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:20.712578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:20.719019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:20.719509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:20.720273 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:20.720705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:20.721879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:20.722588 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:20.728698 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:20.729153 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:20.729929 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:20.730369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:20.966199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:20.974022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:20.975712 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:20.976882 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bd1d8161-e92a-4c19-9d5f-a3264fc6be76 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.268954 May 11 06:46:20.977627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 455/868] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:20 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:21.002400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:21.010218 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ed3620ac-ad41-4420-889b-d00dd6d8b5b3 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.292702 May 11 06:46:21.010783 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 414/869] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:20 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:21.996106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:21.996711 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:22.003037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:22.003524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:22.004289 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:22.004722 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:22.027392 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:22.028109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:22.034313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:22.034755 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:22.035542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:22.035970 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:22.187979 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:22.195616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:22.197137 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:22.198541 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-de824171-8375-4f83-b3de-a7dbec3f4170 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.206634 May 11 06:46:22.199096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 456/870] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:21 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:22.222632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:22.230778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-41c93356-e158-464b-9665-cbf5435ec4f4 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.207760 May 11 06:46:22.231358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 415/871] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:22 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:23.216754 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:23.217354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:23.223707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:23.224158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:23.224917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:23.225351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:23.247602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:23.248209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:23.255131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:23.255600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:23.256374 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:23.256818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:23.418317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:23.426864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:23.428572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:23.429577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b022376b-283c-4478-9b76-2eabd45ae9be tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1731 microversion: 2.20 time: 0.217273 May 11 06:46:23.442740 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 457/872] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:23 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:23.458387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:23.467006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b73e28d7-f1b6-4233-a577-3530fc493492 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.223075 May 11 06:46:23.467364 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 416/873] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:23 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:24.448942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:24.449555 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:24.455912 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:24.456359 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:24.457117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:24.457552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:24.484007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:24.484637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:24.491001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:24.491489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:24.492267 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:24.492707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:24.643337 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:24.650958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:24.652476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:24.654121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0a88d5f2-5b56-4b33-8b54-db9c6af13575 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1718 microversion: 2.20 time: 0.209742 May 11 06:46:24.655184 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 458/874] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:46:24 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1718 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:46:24.682069 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:24.689723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-387dda42-f786-4c06-a999-85e8e1a6fa82 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.209493 May 11 06:46:24.690284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 417/875] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:24 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:46:25.707139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:25.707723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:25.714484 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:25.714966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:25.715771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:25.716203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:25.853823 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:25.861465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e983f017-ca14-440e-bdd4-2822d7ff2be8 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.158323 May 11 06:46:25.862037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 459/876] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:25 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:26.879103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:26.879733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:26.886112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:26.886581 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:26.887370 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:26.887804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:27.028211 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:27.035903 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-579043b4-4d5c-4555-bdee-87f12e9c9226 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.161262 May 11 06:46:27.036478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 418/877] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:26 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:28.053563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:28.054096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:28.060918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:28.061362 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:28.062114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:28.062540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:28.202322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:28.210082 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-eaa5c2b6-e90e-4c55-acf2-ada62e424e90 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.160490 May 11 06:46:28.210662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 460/878] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:28 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:29.227078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:29.227733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:29.234491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:29.234936 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:29.235724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:29.236160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:29.376058 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:29.383751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-06a5873b-c6e0-496e-afe8-4d657ba74721 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.160547 May 11 06:46:29.384320 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 419/879] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:29 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:30.400727 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:30.401341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:30.407834 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:30.408278 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:30.409044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:30.409474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:30.548277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:30.555965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cc682c12-67c6-4ebf-b1a0-9399395c96aa tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.159029 May 11 06:46:30.556543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 461/880] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:30 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:31.572017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:31.573405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:31.579717 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:31.580191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:31.580950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:31.581382 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:31.723659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:31.731629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-870785d2-2ccd-45e6-a3e2-d8071de046d9 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.163445 May 11 06:46:31.732192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 420/881] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:31 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:32.748508 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:32.749038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:32.755587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:32.756033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:32.756786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:32.757478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:32.899944 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:32.907545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-377229d6-1534-4f7b-8f45-06275ea29089 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.163052 May 11 06:46:32.908103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 462/882] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:32 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:33.923804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:33.924408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:33.930707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:33.931156 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:33.932445 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:33.932879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:34.074549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:34.082161 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e20b6313-e37c-4fec-a0a1-5d9c9051ae7b tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1754 microversion: 2.1 time: 0.162190 May 11 06:46:34.082734 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 421/883] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:33 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:35.099608 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:35.100192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:35.107292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:35.107746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:35.108503 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:35.108934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:35.248964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:35.256767 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-31004e70-05a4-43aa-90cd-268d71f3f2e0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1757 microversion: 2.1 time: 0.160970 May 11 06:46:35.257331 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 463/884] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:35 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:42.964017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:42.964607 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:42.970795 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:42.971242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:42.972057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:42.972491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:42.994308 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-87aa4cfb-fe42-4ff8-b351-7761fc68efec tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/ips" status: 200 len: 149 microversion: 2.1 time: 0.034795 May 11 06:46:42.994863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 422/885] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:46:42 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:46:44.294768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "626f673e-3033-49bc-8dcb-2b4499e0618b"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:44.295935 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:44.302227 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:44.302673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:44.303464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:44.303898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:44.561157 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8b8f6e69-75ca-42e9-a68b-c2726801877d tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "POST /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270100 May 11 06:46:44.561775 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 464/886] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:46:44 2022] POST /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:51.363082 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:51.363699 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:51.373692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:51.374516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:51.375931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:51.376732 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:51.403778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-65160ae5-71c0-46ba-afb9-652daef7ef2c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/ips" status: 200 len: 145 microversion: 2.1 time: 0.044568 May 11 06:46:51.404719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 423/887] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:46:51 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:52.119848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:52.120428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:52.126734 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:52.127212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:52.128069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:52.128509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:52.206865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lazy-loading 'services' on Instance uuid ef4191b4-a818-4c0f-95ee-869fd30177e2 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:46:52.273400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7818f6f0-3fdc-4f52-8a54-8f12f80bc880 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments/626f673e-3033-49bc-8dcb-2b4499e0618b" status: 202 len: 0 microversion: 2.1 time: 0.158116 May 11 06:46:52.274010 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 465/888] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:46:52 2022] DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments/626f673e-3033-49bc-8dcb-2b4499e0618b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:46:52.282867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:52.283873 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:52.289791 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:52.290240 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:52.291220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:52.291689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:52.320103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-27497aba-34d0-49d6-bab5-759d56442408 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041120 May 11 06:46:52.320866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 424/889] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:46:52 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:53.333350 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:53.334371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:53.340986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.341429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.342193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.342625 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.370442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-922668e9-2151-48c0-9389-3563407903fa tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041487 May 11 06:46:53.370989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 466/890] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:46:53 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:46:53.426614 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:53.427093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:53.433909 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.434359 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.435118 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.435578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.461103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:46:53.532975 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e2b8d28d-3bf5-497a-a494-c1c382e96a03 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 204 len: 0 microversion: 2.1 time: 0.109736 May 11 06:46:53.533501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 425/891] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:46:53 2022] DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:46:53.543748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:53.544758 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:53.550513 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.550956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.551803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:53.552229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:53.680105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:53.688044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6af85de6-c5b7-4174-bbef-72b65205a5b0 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1681 microversion: 2.1 time: 0.150005 May 11 06:46:53.688613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 467/892] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:53 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:54.705622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:54.706238 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:54.712506 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:54.712952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:54.713710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:54.714141 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:54.846292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:54.854088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d159ca15-4fdb-4dcb-a6a9-d8aa3ab4b44c tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1681 microversion: 2.1 time: 0.152741 May 11 06:46:54.854642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 426/893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:54 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:54.961595 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eacb3ce7-9c13-4ea3-a788-ec019f515c02"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:54.963346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:54.969607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:54.970351 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:54.971110 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:54.971567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:55.322026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a18be337-ea2d-491b-94b2-b9a468673466 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364438 May 11 06:46:55.322632 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 468/894] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:46:54 2022] POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:55.870636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:55.871187 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:55.877422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:55.877873 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:55.878637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:55.879074 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:56.118348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57cd656669e42bea86c8206b333bd6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4348f294cc464f89b2334676442d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:46:56.126293 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f042f08c-25c9-4ace-8f36-067d2b9d5be9 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 200 len: 1681 microversion: 2.1 time: 0.260160 May 11 06:46:56.126951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 427/895] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:55 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:46:56.538840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-942c890b-0c94-4dd9-b943-42071e42e5ac req-26679f65-1698-45c7-8616-8716742595bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4191b4-a818-4c0f-95ee-869fd30177e2", "name": "network-vif-deleted", "tag": "7970ee38-ee7c-48dd-b7d9-3efd0916a387"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:46:56.549456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-942c890b-0c94-4dd9-b943-42071e42e5ac req-26679f65-1698-45c7-8616-8716742595bf service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:56.549958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-942c890b-0c94-4dd9-b943-42071e42e5ac req-26679f65-1698-45c7-8616-8716742595bf service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:56.561886 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-942c890b-0c94-4dd9-b943-42071e42e5ac req-26679f65-1698-45c7-8616-8716742595bf service nova] Creating event network-vif-deleted:7970ee38-ee7c-48dd-b7d9-3efd0916a387 for instance ef4191b4-a818-4c0f-95ee-869fd30177e2 on hv-cinder-80475 May 11 06:46:56.567054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-942c890b-0c94-4dd9-b943-42071e42e5ac req-26679f65-1698-45c7-8616-8716742595bf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 May 11 06:46:56.567964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 469/896] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:46:57.143579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:57.144918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:57.152030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:57.152495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:57.153278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:57.153712 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:57.167606 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 HTTP/1.1 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:46:57.169714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:57.171366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'ef4191b4-a818-4c0f-95ee-869fd30177e2'} May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:46:57.172318 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:57.173854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:57.175896 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:46:57.176730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fbe2a2c7-8496-488e-8a2e-d98d78d0c8c5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 404 len: 111 microversion: 2.1 time: 0.037343 May 11 06:46:57.177450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 428/897] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:57 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:46:57.186356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-edb64d85-818f-4ce2-b9e0-e6739c0953d5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '.version_select at 0x7fc5c8b9f820>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:57.204897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-edb64d85-818f-4ce2-b9e0-e6739c0953d5 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140120323" status: 202 len: 0 microversion: 2.1 time: 0.022516 May 11 06:46:57.205675 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 470/898] 10.222.0.64 () {58 vars in 1217 bytes} [Wed May 11 06:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140120323 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:46:58.958812 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:58.959320 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:58.966229 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:58.966671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:58.967452 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:58.967881 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:58.980803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 HTTP/1.1 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:46:58.982289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:58.983846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'ef4191b4-a818-4c0f-95ee-869fd30177e2'} May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:46:58.984971 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:58.986386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:46:58.987928 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:46:58.987928 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5218d65d-a8ba-4563-aec1-728f465b7560 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 404 len: 111 microversion: 2.1 time: 0.028582 May 11 06:46:58.987928 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 429/899] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:46:58 2022] DELETE /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:46:58.993164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:46:58.993975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: ef4191b4-a818-4c0f-95ee-869fd30177e2] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:46:59.000774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:59.001234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:59.002029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:46:59.002474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:46:59.016102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 HTTP/1.1 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:46:59.017720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:59.019228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'ef4191b4-a818-4c0f-95ee-869fd30177e2'} May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:46:59.020189 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. May 11 06:46:59.022125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:46:59.023651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance ef4191b4-a818-4c0f-95ee-869fd30177e2 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:46:59.023651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6c71fe1-dd2b-45be-a509-5c03ef8abd33 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2" status: 404 len: 111 microversion: 2.1 time: 0.030967 May 11 06:46:59.023651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 471/900] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:46:58 2022] GET /compute/v2.1/servers/ef4191b4-a818-4c0f-95ee-869fd30177e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:00.149517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:00.150523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:00.156894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.157344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.158110 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.158546 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.172250 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 HTTP/1.1 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:00.173767 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.175404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '09d780cb-2ea7-4645-937d-03eef82ae3c4'} May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:00.176269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.177772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.179226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:00.179226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6096c3c3-1446-47f6-81fc-fd2895b3a24a tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 404 len: 111 microversion: 2.1 time: 0.029736 May 11 06:47:00.179226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 430/901] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:47:00 2022] DELETE /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:00.184429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:00.185091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 09d780cb-2ea7-4645-937d-03eef82ae3c4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:00.191349 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.191796 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.192548 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.192975 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.206571 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 HTTP/1.1 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:00.208425 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.209981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '09d780cb-2ea7-4645-937d-03eef82ae3c4'} May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:00.210837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. May 11 06:47:00.212281 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.214065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 09d780cb-2ea7-4645-937d-03eef82ae3c4 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:00.214065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a2a7f6c7-e34b-4f98-8684-7d6dd2f898a2 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4" status: 404 len: 111 microversion: 2.1 time: 0.030009 May 11 06:47:00.214065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 472/902] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:00 2022] GET /compute/v2.1/servers/09d780cb-2ea7-4645-937d-03eef82ae3c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:00.219044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:00.219556 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:00.225418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.225859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.226609 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.227036 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.240022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 HTTP/1.1 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:00.241513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.243051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '10f9778e-fe70-41f8-b12c-d55c6aa0ade9'} May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:00.243863 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.245065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:00.246216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:00.246216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4f806f5b-d314-4337-a89c-ad7caaf6f39f tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 404 len: 111 microversion: 2.1 time: 0.027535 May 11 06:47:00.246216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 431/903] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:47:00 2022] DELETE /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:00.251195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:00.251848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: 10f9778e-fe70-41f8-b12c-d55c6aa0ade9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:00.257641 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.258120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.258871 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:00.259833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:00.272817 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 HTTP/1.1 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:00.274378 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.276572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '10f9778e-fe70-41f8-b12c-d55c6aa0ade9'} May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:00.277533 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. May 11 06:47:00.278919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:00.280368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance 10f9778e-fe70-41f8-b12c-d55c6aa0ade9 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:00.280368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-60108114-b2e8-4300-9a94-1f6509871541 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9" status: 404 len: 111 microversion: 2.1 time: 0.028790 May 11 06:47:00.280368 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 473/904] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:00 2022] GET /compute/v2.1/servers/10f9778e-fe70-41f8-b12c-d55c6aa0ade9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:01.402530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:01.403006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:01.409287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:01.409723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:01.410474 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:01.410900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:01.424527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a HTTP/1.1 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:01.426357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.427923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'fe36d742-5157-4f04-9f55-02dfafa7d39a'} May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:01.428785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.430180 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:01.432385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:01.432385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6ce420a5-9bf9-4a93-b024-c9450c356a79 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 404 len: 111 microversion: 2.1 time: 0.029671 May 11 06:47:01.432385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 432/905] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:47:01 2022] DELETE /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:01.436527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:01.437137 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] [instance: fe36d742-5157-4f04-9f55-02dfafa7d39a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:01.443760 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:01.444207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:01.444965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:01.445399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:01.459565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] HTTP exception thrown: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Request method failure captured: May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a HTTP/1.1 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oTNEKIvJvFWOx50lLQElXhfkCjc82gO6GkopVcoBi3EjtoUyJdPk2LD6B0MRVOrZy-6JVdBboREDZJVPuSZkf94JgdWtV0IdfJM_YIg63dezWpdjkWhEyS2wacw4iw8Oz0h96fgsOvXNFFgwU2WgAo-pWXJFHgtDhjQHqIt2MktpI May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:01.461060 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb4348f294cc464f89b2334676442d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb4348f294cc464f89b2334676442d25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb4348f294cc464f89b2334676442d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: eb4348f294cc464f89b2334676442d25 May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904882873 May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: e57cd656669e42bea86c8206b333bd6d May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeNegativeTest-1904882873-project May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.462520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'fe36d742-5157-4f04-9f55-02dfafa7d39a'} May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:01.463412 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. May 11 06:47:01.464788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:01.466046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] Returning 404 to user: Instance fe36d742-5157-4f04-9f55-02dfafa7d39a could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:01.466046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7d07944e-b616-4d04-ba5f-421de8d50f74 tempest-AttachVolumeNegativeTest-1904882873 tempest-AttachVolumeNegativeTest-1904882873-project] 10.222.0.64 "GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a" status: 404 len: 111 microversion: 2.1 time: 0.029700 May 11 06:47:01.466046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 474/906] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:01 2022] GET /compute/v2.1/servers/fe36d742-5157-4f04-9f55-02dfafa7d39a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:02.810165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-79761be4-3b42-41a5-9589-545d29da95fe tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:02.816888 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79761be4-3b42-41a5-9589-545d29da95fe tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:02.817927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79761be4-3b42-41a5-9589-545d29da95fe tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:02.881108 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-79761be4-3b42-41a5-9589-545d29da95fe tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Going to try to stop instance {{(pid=128923) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 06:47:02.923509 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-79761be4-3b42-41a5-9589-545d29da95fe tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action" status: 202 len: 0 microversion: 2.1 time: 0.117828 May 11 06:47:02.924043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 433/907] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:47:02 2022] POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:02.932643 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:02.938304 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:02.945364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:02.945920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:02.947404 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:02.947945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:03.131435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:03.139535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a848044b-0003-4cfc-9c00-687f7dc1b73a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.211133 May 11 06:47:03.140192 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 475/908] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:02 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:04.158091 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:04.159385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:04.167707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:04.168412 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:04.169362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:04.169965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:04.413099 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:04.421377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-208eded3-86da-484f-b36e-bf89099d9981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.268074 May 11 06:47:04.422413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 434/909] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:04 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:05.440901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:05.441553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:05.448791 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:05.449197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:05.449953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:05.450388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:05.585409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:05.593867 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1d7ee81d-9136-40ac-8535-65d58b4061c2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.157416 May 11 06:47:05.594473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 476/910] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:05 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:05.974751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:05.975751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:05.982618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:05.983068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:05.983871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:05.984307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.017439 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b79acfc3-d9d3-4885-b75c-90a14372fccc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046684 May 11 06:47:06.017996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 435/911] 10.222.0.64 () {60 vars in 1342 bytes} [Wed May 11 06:47:05 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:06.076718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:06.077146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:06.083000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.083440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.084205 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.084640 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.110129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:47:06.204787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2e2628e7-4cf2-4223-a0f6-24b770d63951 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 204 len: 0 microversion: 2.20 time: 0.131783 May 11 06:47:06.205808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 477/912] 10.222.0.64 () {60 vars in 1279 bytes} [Wed May 11 06:47:06 2022] DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:47:06.214404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:06.215258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:06.226118 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.227353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.229283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.229947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.392615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:06.400682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:06.402258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:06.403467 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-02a29962-83cc-4be3-8100-d1889aa4d659 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.193349 May 11 06:47:06.404023 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 436/913] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:06 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:47:06.611688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:06.612386 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:06.618575 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.619064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.619849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:06.620275 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:06.920329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:06.928130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f359db74-cf81-4998-a0fa-b1b41107524b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.320686 May 11 06:47:06.928935 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 478/914] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:06 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:07.422066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:07.422760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:07.429231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:07.429945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:07.430618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:07.431655 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:07.920387 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:07.928958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:07.930484 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:07.931884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e8d685c8-0a29-492c-9ff0-e692a1723c0e tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1724 microversion: 2.20 time: 0.513790 May 11 06:47:07.932450 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 437/915] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:07 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1724 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:47:07.950995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:07.951742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:07.959308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:07.959773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:07.960812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:07.961262 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:08.174782 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:08.192154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f03e96f9-d595-4685-9cb0-d02767663d93 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.246227 May 11 06:47:08.193002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 479/916] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:07 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:08.878043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-417fc359-d166-4f99-9ec8-01473ba02f4c req-bf39f560-c3df-480a-bcab-839deb5a4eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596cbeb7-7356-4919-913a-a0adace78883", "name": "network-vif-deleted", "tag": "0c976279-8b75-4fa9-9ca3-337753d9430e"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:08.887495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-417fc359-d166-4f99-9ec8-01473ba02f4c req-bf39f560-c3df-480a-bcab-839deb5a4eac service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:08.887942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-417fc359-d166-4f99-9ec8-01473ba02f4c req-bf39f560-c3df-480a-bcab-839deb5a4eac service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:08.901510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-417fc359-d166-4f99-9ec8-01473ba02f4c req-bf39f560-c3df-480a-bcab-839deb5a4eac service nova] Creating event network-vif-deleted:0c976279-8b75-4fa9-9ca3-337753d9430e for instance 596cbeb7-7356-4919-913a-a0adace78883 on hv-cinder-80475 May 11 06:47:08.907312 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-417fc359-d166-4f99-9ec8-01473ba02f4c req-bf39f560-c3df-480a-bcab-839deb5a4eac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 May 11 06:47:08.913174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 438/917] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:47:08.951487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:08.952357 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:08.959244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:08.959905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:08.961046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:08.961676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:09.058550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:09.069489 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:09.072238 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f2d12e60ae147198c3940c510616285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea42234bb6844ce88afe0725d859863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:09.074018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-153f5a9d-d8e8-4291-bd03-b983e1945513 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 200 len: 1367 microversion: 2.20 time: 0.127179 May 11 06:47:09.075234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 480/918] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:08 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 1367 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:47:09.210679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:09.211523 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:09.219637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:09.220778 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:09.221901 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:09.222348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:09.369550 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:09.378148 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1b7913ad-5aa6-4247-9b43-3cf426232995 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.171694 May 11 06:47:09.378965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 439/919] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:09 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:10.093217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:10.094061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:10.102080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:10.103283 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:10.104431 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:10.106052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:10.126109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 HTTP/1.1 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:10.128166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:10.129783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '596cbeb7-7356-4919-913a-a0adace78883'} May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:10.130660 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:10.132251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:10.134447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:10.134447 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5a067e2c-1584-4b1b-a220-bdbd405f0b23 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 404 len: 111 microversion: 2.20 time: 0.042057 May 11 06:47:10.137031 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 481/920] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:10 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 06:47:10.142265 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e96e1080-529c-439d-a9b7-9db66c9f77cc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '.version_select at 0x7fc5cde84790>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:10.169429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e96e1080-529c-439d-a9b7-9db66c9f77cc tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776342463" status: 204 len: 0 microversion: 2.20 time: 0.031511 May 11 06:47:10.170015 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 440/921] 10.222.0.64 () {60 vars in 1261 bytes} [Wed May 11 06:47:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776342463 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:47:10.395302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:10.396044 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:10.402388 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:10.403148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:10.404549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:10.405110 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:10.551253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:10.559665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-428090c9-d747-4d6a-aafd-8351d265b059 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.168157 May 11 06:47:10.560394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 482/922] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:10 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:11.577093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:11.577769 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:11.584879 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.585408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:11.586231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.586730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:11.727979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:11.735596 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-60b89d6a-9c97-4764-8ab6-4f99bdd643ce tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.162668 May 11 06:47:11.736159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 441/923] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:11 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:11.951433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:11.951936 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:11.958342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.958852 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:11.959683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.960125 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:11.973308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 HTTP/1.1 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:11.974860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:11.976505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '596cbeb7-7356-4919-913a-a0adace78883'} May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:11.977547 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:11.978964 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:11.980749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:11.980749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3265b3f1-5f45-4dcd-bf5b-6fc3898b3de5 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 404 len: 111 microversion: 2.20 time: 0.029578 May 11 06:47:11.980749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 483/924] 10.222.0.64 () {60 vars in 1279 bytes} [Wed May 11 06:47:11 2022] DELETE /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:47:11.984454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:11.985064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 596cbeb7-7356-4919-913a-a0adace78883] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:11.990804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.991257 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:11.992053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:11.992489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:12.005820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 HTTP/1.1 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:12.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:12.009549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '596cbeb7-7356-4919-913a-a0adace78883'} May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:12.010464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. May 11 06:47:12.011913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:12.013575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 596cbeb7-7356-4919-913a-a0adace78883 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:12.013575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6788d5aa-877c-4cce-9e72-bc3030667138 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883" status: 404 len: 111 microversion: 2.20 time: 0.028152 May 11 06:47:12.013575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 442/925] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:11 2022] GET /compute/v2.1/servers/596cbeb7-7356-4919-913a-a0adace78883 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:47:12.752398 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:12.753001 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:12.758778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:12.759222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:12.759999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:12.760429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:12.898191 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:12.907365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-79beb6b6-53d3-45de-b9d3-34ef4edf806b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.158709 May 11 06:47:12.908396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 484/926] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:12 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:13.138711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:13.139216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:13.145501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.145947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:13.146704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.147134 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:13.160412 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec HTTP/1.1 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:13.161866 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.163575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '86b8d3ad-c5ac-43be-9752-33e7891c2aec'} May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:13.164743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.167164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:13.168823 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:13.168823 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1fc2b6fd-630a-476c-92c2-5df4c6dc2e6c tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 404 len: 111 microversion: 2.20 time: 0.028339 May 11 06:47:13.168823 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 443/927] 10.222.0.64 () {60 vars in 1279 bytes} [Wed May 11 06:47:13 2022] DELETE /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:47:13.171987 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:13.172583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] [instance: 86b8d3ad-c5ac-43be-9752-33e7891c2aec] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:13.178849 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.179317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:13.180068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.180499 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:13.193845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] HTTP exception thrown: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Request method failure captured: May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec HTTP/1.1 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1oUoJV6xzNQH1gixazrA-vkxb8VMeDJ3nAMbbDonA8YagJ6pPVUCtC9nCbICwGf4pY26lIMOhEwMQ5kzZqpcMvVpFRKB7iDnxpLjHyJNHTTZRj6jQq3PPiUxLS8cZmtJQsgqLliT0Q3adFsrefFdTY0l1L-IdZ5HMan3yU3NUHYkgk May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:13.195369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ea42234bb6844ce88afe0725d859863e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ea42234bb6844ce88afe0725d859863e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ea42234bb6844ce88afe0725d859863e May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-327040697 May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 1f2d12e60ae147198c3940c510616285 May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-327040697-project May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.196978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '86b8d3ad-c5ac-43be-9752-33e7891c2aec'} May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:13.197846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. May 11 06:47:13.199714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:13.201260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] Returning 404 to user: Instance 86b8d3ad-c5ac-43be-9752-33e7891c2aec could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:13.201260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-887176bb-453c-43be-a175-84579307b848 tempest-AttachVolumeShelveTestJSON-327040697 tempest-AttachVolumeShelveTestJSON-327040697-project] 10.222.0.64 "GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec" status: 404 len: 111 microversion: 2.20 time: 0.028598 May 11 06:47:13.201260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 485/928] 10.222.0.64 () {60 vars in 1276 bytes} [Wed May 11 06:47:13 2022] GET /compute/v2.1/servers/86b8d3ad-c5ac-43be-9752-33e7891c2aec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:47:13.932206 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:13.932806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:13.938473 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.939877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:13.940645 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:13.941073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:14.071283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:14.079434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bea1b47e-c289-4291-a17d-f1e7bae5ab53 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.150991 May 11 06:47:14.080009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 444/929] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:13 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:15.096968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:15.097593 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:15.104613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:15.105113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:15.105838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:15.106353 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:15.241019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:15.249837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e864e9b4-543d-4372-8597-d067bf1aac9c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.156807 May 11 06:47:15.250399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 486/930] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:15 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:16.266875 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:16.267540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:16.273668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:16.274124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:16.274938 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:16.275400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:16.416986 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:16.432543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-564bb869-2988-4cf5-9492-4d474e11b4f2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.169487 May 11 06:47:16.433225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 445/931] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:16 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:17.146755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-963399563"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:17.147775 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:17.154257 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:17.154741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:17.155771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:17.156207 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:17.294497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.network.security_group_api [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Removing security group 7997d7bc-cf0c-4955-aaac-0e43a6dee0e4 from port c252b84e-76c5-4079-b1f3-11dd833563b3 May 11 06:47:17.450526 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:17.451154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:17.457861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:17.458516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:17.459327 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:17.459770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:17.697109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:17.706348 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7ee2feb3-c501-45bf-8fdc-69b346014747 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1723 microversion: 2.1 time: 0.260454 May 11 06:47:17.707317 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 446/932] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:17 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:47:17.770367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-005eed07-d442-4c08-8527-dbec561d3241 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action" status: 202 len: 0 microversion: 2.1 time: 0.627565 May 11 06:47:17.773930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 487/933] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:47:17 2022] POST /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:47:17.781985 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-8cc3192a-27ef-46e9-9dfd-d6a0cd7edf81 req-3532d63c-0795-4f8e-a422-338e3407c04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:17.791558 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-8cc3192a-27ef-46e9-9dfd-d6a0cd7edf81 req-3532d63c-0795-4f8e-a422-338e3407c04e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:17.792002 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-8cc3192a-27ef-46e9-9dfd-d6a0cd7edf81 req-3532d63c-0795-4f8e-a422-338e3407c04e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:17.811932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-8cc3192a-27ef-46e9-9dfd-d6a0cd7edf81 req-3532d63c-0795-4f8e-a422-338e3407c04e service nova] Creating event network-changed:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:47:17.822890 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-8cc3192a-27ef-46e9-9dfd-d6a0cd7edf81 req-3532d63c-0795-4f8e-a422-338e3407c04e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044600 May 11 06:47:17.824193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 447/934] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:18.723471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:18.724850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:18.731549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:18.732254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:18.733291 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:18.733957 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:18.983594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:18.993464 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-958dc59a-ea1c-4806-84bf-6734bd720f58 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1700 microversion: 2.1 time: 0.273099 May 11 06:47:18.994341 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 488/935] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:18 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1700 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:19.010720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-740b0299-1099-4a99-b673-5bbf005c84a0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:19.020994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-740b0299-1099-4a99-b673-5bbf005c84a0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.021647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-740b0299-1099-4a99-b673-5bbf005c84a0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.048768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-740b0299-1099-4a99-b673-5bbf005c84a0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Going to try to start instance {{(pid=128923) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 06:47:19.096197 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-740b0299-1099-4a99-b673-5bbf005c84a0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action" status: 202 len: 0 microversion: 2.1 time: 0.089579 May 11 06:47:19.096801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 448/936] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:47:19 2022] POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:19.108518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:19.109599 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:19.119251 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.122579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.123837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.124290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.346787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:19.358592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6436017-a926-41c3-a447-9409140c486a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1709 microversion: 2.1 time: 0.257047 May 11 06:47:19.359583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 489/937] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:19 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1709 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:19.362417 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:19.363012 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:19.369139 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.369589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.370369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.370794 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.460837 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lazy-loading 'services' on Instance uuid eb45216e-937f-4c83-98eb-4686d045da6f {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:47:19.542967 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-47da2ecc-6028-480e-a7ad-14ac64a3159f tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments/bf33d6c1-ca56-474d-ad6e-991f17cccbcd" status: 202 len: 0 microversion: 2.1 time: 0.184635 May 11 06:47:19.544349 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 449/938] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:47:19 2022] DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments/bf33d6c1-ca56-474d-ad6e-991f17cccbcd => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:19.553631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:19.555034 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:19.562356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.562945 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.564029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.564534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.598411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc42684c-5335-4a0a-b1f6-4bb52dcbc283 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049987 May 11 06:47:19.599105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 490/939] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:47:19 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:19.842059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-51274fe2-1cd3-419b-900c-9e3cb6d09007 req-9dd3628e-ea56-45b2-8470-2d9cb24b2a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:19.851712 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-51274fe2-1cd3-419b-900c-9e3cb6d09007 req-9dd3628e-ea56-45b2-8470-2d9cb24b2a10 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:19.852984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-51274fe2-1cd3-419b-900c-9e3cb6d09007 req-9dd3628e-ea56-45b2-8470-2d9cb24b2a10 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:19.865566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-51274fe2-1cd3-419b-900c-9e3cb6d09007 req-9dd3628e-ea56-45b2-8470-2d9cb24b2a10 service nova] Creating event network-changed:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:47:19.873053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-51274fe2-1cd3-419b-900c-9e3cb6d09007 req-9dd3628e-ea56-45b2-8470-2d9cb24b2a10 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 May 11 06:47:19.874011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 450/940] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:20.376116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:20.376981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:20.387352 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.387846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.388861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.389371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.612552 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:20.616398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:20.628787 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.630686 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.631703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.632274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.659847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:20.679618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1c3b4e88-4979-4d90-9f4f-29d2e207295a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1709 microversion: 2.1 time: 0.307323 May 11 06:47:20.680434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 491/941] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:20 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1709 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:20.697947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8efa6a39-7596-4c43-8965-c7aea58ac669 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091019 May 11 06:47:20.704579 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 451/942] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:47:20 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:47:20.716357 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:20.717315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:20.726534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.727714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.728800 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:20.729588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:20.835160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] HTTP exception thrown: Instance eb45216e-937f-4c83-98eb-4686d045da6f is not attached to volume bf33d6c1-ca56-474d-ad6e-991f17cccbcd May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Request method failure captured: May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments/bf33d6c1-ca56-474d-ad6e-991f17cccbcd HTTP/1.1 May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1thJpImzSZldC-4Iv0VHl63mgjqBAdYrEGfOrNrdstcfTHpIONKKEDrQVBu2mSzDT4fiv7TbznzVbDKelSvwhZZiMThiDg6hhOL9sVToRtWunY9czhSPqGya1VSlDdS2ZVkhJv2_hvqQu7YAC8hawK6aM_HrgDW7cFqS_HI9krO9rI May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ee00a37abf8a49eba7d06738e181eb4b May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:47:20.842915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ee00a37abf8a49eba7d06738e181eb4b May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-TestMinimumBasicScenario-564548976-project May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: bd7b114dcefa4088851a61b3c7283b21 May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-TestMinimumBasicScenario-564548976-project May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:47:20.844594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance eb45216e-937f-4c83-98eb-4686d045da6f is not attached to volume bf33d6c1-ca56-474d-ad6e-991f17cccbcd May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'server_id': 'eb45216e-937f-4c83-98eb-4686d045da6f', 'id': 'bf33d6c1-ca56-474d-ad6e-991f17cccbcd'} May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf33d6c1-ca56-474d-ad6e-991f17cccbcd. May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:20.845419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb45216e-937f-4c83-98eb-4686d045da6f is not attached to volume bf33d6c1-ca56-474d-ad6e-991f17cccbcd May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb45216e-937f-4c83-98eb-4686d045da6f is not attached to volume bf33d6c1-ca56-474d-ad6e-991f17cccbcd May 11 06:47:20.847461 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:47:20.848912 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Returning 404 to user: Instance eb45216e-937f-4c83-98eb-4686d045da6f is not attached to volume bf33d6c1-ca56-474d-ad6e-991f17cccbcd {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:20.850094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a874a46b-0fc1-4344-b742-ed50435a474d tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments/bf33d6c1-ca56-474d-ad6e-991f17cccbcd" status: 404 len: 154 microversion: 2.1 time: 0.139156 May 11 06:47:20.852188 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 492/943] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:47:20 2022] DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f/os-volume_attachments/bf33d6c1-ca56-474d-ad6e-991f17cccbcd => generated 154 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:47:21.698035 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:21.698991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:21.705385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:21.708640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:21.708640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:21.708640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:21.845499 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:21.853547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bba7c968-8ab7-406b-8587-6c221fa0ab4a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1713 microversion: 2.1 time: 0.159675 May 11 06:47:21.854128 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 452/944] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:21 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:47:22.001259 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:22.001768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:22.008121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:22.009115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:22.009877 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:22.010314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:22.037111 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:47:22.114234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-582fd5dc-0321-4a89-8827-8e9b9cfc65bf tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 204 len: 0 microversion: 2.1 time: 0.116596 May 11 06:47:22.118659 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 493/945] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:47:21 2022] DELETE /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:47:22.124278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:22.124902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:22.131116 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:22.131600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:22.132366 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:22.132807 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:22.268815 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:22.276741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-95aa8952-9ff6-4545-a14c-df005ebf8449 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1553 microversion: 2.1 time: 0.156951 May 11 06:47:22.277305 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 453/946] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:22 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:23.294904 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:23.295642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:23.302070 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:23.302530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:23.303405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:23.303845 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:23.439315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:23.451110 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1f971b43-18ae-4b46-858f-4c7149e6e45c tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1553 microversion: 2.1 time: 0.160134 May 11 06:47:23.451717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 494/947] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:23 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:24.469400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:24.470017 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:24.476827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:24.477300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:24.478072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:24.478510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:24.705453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd7b114dcefa4088851a61b3c7283b21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee00a37abf8a49eba7d06738e181eb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:24.714916 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f9c8b236-07d9-4ba1-a355-3ea302dd5f94 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 200 len: 1553 microversion: 2.1 time: 0.250141 May 11 06:47:24.715630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 454/948] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:24 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:24.890662 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-d6b7ccc5-274b-4635-8883-43eb5828d605 req-fdddab78-35cd-476e-8228-22ae459ff809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45216e-937f-4c83-98eb-4686d045da6f", "name": "network-vif-deleted", "tag": "c252b84e-76c5-4079-b1f3-11dd833563b3"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:24.900913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d6b7ccc5-274b-4635-8883-43eb5828d605 req-fdddab78-35cd-476e-8228-22ae459ff809 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:24.901861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d6b7ccc5-274b-4635-8883-43eb5828d605 req-fdddab78-35cd-476e-8228-22ae459ff809 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:24.915770 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-d6b7ccc5-274b-4635-8883-43eb5828d605 req-fdddab78-35cd-476e-8228-22ae459ff809 service nova] Creating event network-vif-deleted:c252b84e-76c5-4079-b1f3-11dd833563b3 for instance eb45216e-937f-4c83-98eb-4686d045da6f on hv-cinder-80475 May 11 06:47:24.921540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-d6b7ccc5-274b-4635-8883-43eb5828d605 req-fdddab78-35cd-476e-8228-22ae459ff809 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 May 11 06:47:24.922414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 495/949] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:25.732191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:25.732979 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] [instance: eb45216e-937f-4c83-98eb-4686d045da6f] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:25.739418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:25.740114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:25.741042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:25.741633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:25.755798 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] HTTP exception thrown: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Request method failure captured: May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f HTTP/1.1 May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1thJpImzSZldC-4Iv0VHl63mgjqBAdYrEGfOrNrdstcfTHpIONKKEDrQVBu2mSzDT4fiv7TbznzVbDKelSvwhZZiMThiDg6hhOL9sVToRtWunY9czhSPqGya1VSlDdS2ZVkhJv2_hvqQu7YAC8hawK6aM_HrgDW7cFqS_HI9krO9rI May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ee00a37abf8a49eba7d06738e181eb4b May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:47:25.757425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee00a37abf8a49eba7d06738e181eb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ee00a37abf8a49eba7d06738e181eb4b May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-TestMinimumBasicScenario-564548976 May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-TestMinimumBasicScenario-564548976-project May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: bd7b114dcefa4088851a61b3c7283b21 May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-TestMinimumBasicScenario-564548976-project May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. May 11 06:47:25.759633 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'eb45216e-937f-4c83-98eb-4686d045da6f'} May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:47:25.761105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. May 11 06:47:25.763087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:47:25.764642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Returning 404 to user: Instance eb45216e-937f-4c83-98eb-4686d045da6f could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:47:25.764642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1ec0d562-cb72-4ac4-97a1-2a3d1693ebb2 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f" status: 404 len: 111 microversion: 2.1 time: 0.030923 May 11 06:47:25.764642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 455/950] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:25 2022] GET /compute/v2.1/servers/eb45216e-937f-4c83-98eb-4686d045da6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:47:25.768634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-475f4f7d-d539-4ab2-a0b0-d40d33316ae0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] Calling method '.version_select at 0x7fc5c8b56f70>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:25.793970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-475f4f7d-d539-4ab2-a0b0-d40d33316ae0 tempest-TestMinimumBasicScenario-564548976 tempest-TestMinimumBasicScenario-564548976-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2017886493" status: 202 len: 0 microversion: 2.1 time: 0.029366 May 11 06:47:25.794563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 496/951] 10.222.0.64 () {58 vars in 1271 bytes} [Wed May 11 06:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2017886493 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:30.025142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:47:30.025803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:47:49.240242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1a68d0ad-2a7c-4e56-aa5b-af15ddaebc86 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Action: 'create', calling method: .version_select at 0x7fc5c8347b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-438922881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0RGWuekAnjFsd8ky9nUU3PCAVBEThXDUOxF977y9NHc+3Kqy3/+e4VF4zkatoFWmxSFFBEjxXMLehV8HkDGF35KBB/fSFD6Diw2BYykXtKXhsGtCmT7t8+xfBYwKfcTg=="}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:49.273105 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-1a68d0ad-2a7c-4e56-aa5b-af15ddaebc86 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Getting quotas for project e6758effb73344c895a7ed675378f8df. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:47:49.287214 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-1a68d0ad-2a7c-4e56-aa5b-af15ddaebc86 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Getting quotas for user f0b99029c246448da0a2d0e26a16f43d and project e6758effb73344c895a7ed675378f8df. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:47:49.327541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1a68d0ad-2a7c-4e56-aa5b-af15ddaebc86 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.390790 May 11 06:47:49.328396 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 456/952] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:47:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:55.030295 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:55.032249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:55.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:55.042091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:55.045916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:55.046371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:55.181225 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lazy-loading 'services' on Instance uuid 319d4a2d-cf16-4a05-824b-f0e457578c58 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:47:55.295802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f5803d0f-4abb-474a-8c7f-b4c6c93abf75 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments/eacb3ce7-9c13-4ea3-a788-ec019f515c02" status: 202 len: 0 microversion: 2.1 time: 0.268433 May 11 06:47:55.302535 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 497/953] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:47:55 2022] DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments/eacb3ce7-9c13-4ea3-a788-ec019f515c02 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:56.474638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-39fdc9a1-6fa7-4296-a886-38c224b82d8b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:56.488172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-39fdc9a1-6fa7-4296-a886-38c224b82d8b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:56.488629 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-39fdc9a1-6fa7-4296-a886-38c224b82d8b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:56.537471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-39fdc9a1-6fa7-4296-a886-38c224b82d8b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Going to try to stop instance {{(pid=128923) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 06:47:56.649800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-39fdc9a1-6fa7-4296-a886-38c224b82d8b tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action" status: 202 len: 0 microversion: 2.1 time: 0.188099 May 11 06:47:56.653952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 457/954] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:47:56 2022] POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:47:56.662516 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:56.668866 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:56.680243 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:56.681101 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:56.682265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:56.683063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:56.996549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:57.011982 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f20afda2-b5d8-474d-8ae8-52e14e809672 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.354690 May 11 06:47:57.021386 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 498/955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:56 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:47:58.031920 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:58.033855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:58.043875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:58.044713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:58.045585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:58.046105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:58.223411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-372e9a5d-c5d9-4348-80f3-b934843ad209 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Action: 'create', calling method: .version_select at 0x7fc5c84285e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1340440310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpkDjVy0l8XSk+1/ATwfXL8tA7ZklEVe0STHa2mbKD5ZHyua7cAy2zql2+GgWfO9scf/NxwK2+4xRsh4Zd0k3LzHBkllUAVHcSzcngf4ZVUvt3Tjs4weDRxZQWHxIKnPA=="}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:47:58.245213 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-372e9a5d-c5d9-4348-80f3-b934843ad209 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:47:58.247518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:58.249423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-372e9a5d-c5d9-4348-80f3-b934843ad209 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for user 94cdac893464447ea8753d29ac7c629b and project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'key_pairs'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:47:58.255288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8dfdde51-d751-44ef-8c86-34b1eec9e058 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.229223 May 11 06:47:58.256235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 499/956] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:58 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:47:58.271537 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-372e9a5d-c5d9-4348-80f3-b934843ad209 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.286590 May 11 06:47:58.272226 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 458/957] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:47:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:47:59.277057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:47:59.278857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:47:59.286322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:59.286775 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:59.287758 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:47:59.288201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:47:59.485347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:47:59.494793 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e49b0c7f-001e-442e-b028-adb2468bc416 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.225512 May 11 06:47:59.506068 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 500/958] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:47:59 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:00.513137 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:00.515221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:00.527321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:00.527959 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:00.528772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:00.529383 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:00.689831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:00.698815 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-24355d13-37f6-4d6e-89cf-9a9cd176c36d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.189911 May 11 06:48:00.699420 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 459/959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:00 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:01.716358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:01.716967 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:01.723897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:01.724451 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:01.725319 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:01.725820 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:01.866890 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:01.874994 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2690eaa4-2ec7-47bd-8d1f-d9adb22faab1 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.162475 May 11 06:48:01.875831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 501/960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:01 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:02.891943 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:02.892544 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:02.899384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:02.900403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:02.901362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:02.902473 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:03.044483 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:03.052106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-647e9df6-d993-4306-a76b-369ffdbfa588 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.163978 May 11 06:48:03.052688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 460/961] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:02 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:04.069649 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:04.070913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:04.078155 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:04.078400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:04.079130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:04.079588 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:04.220999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:04.229607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7d639108-5fe9-4c7c-b6da-c2764e013768 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.163756 May 11 06:48:04.230174 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 502/962] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:04 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:05.246796 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:05.247442 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:05.254386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:05.255098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:05.256158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:05.256740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:05.392719 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:05.402353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-66438e63-82ff-40a5-ba7d-c50ceaf8a3c5 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.159492 May 11 06:48:05.403175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 461/963] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:05 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:06.420981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:06.421623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:06.428820 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:06.429980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:06.430787 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:06.431229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:06.627744 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:06.640603 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0c28ac4f-4c4f-4085-83bf-16e3a72c3fd3 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1677 microversion: 2.1 time: 0.222657 May 11 06:48:06.641232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 503/964] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:06 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:07.657603 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:07.658203 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:07.665133 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:07.665508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:07.666271 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:07.666705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:07.794515 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:07.801977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a01a166d-6e35-4a7f-a25e-fed13db95ea2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1654 microversion: 2.1 time: 0.148220 May 11 06:48:07.802540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 462/965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:07 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:07.818713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0688b6f5-882f-4069-a64a-8f5e8c9a2afb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:07.825966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0688b6f5-882f-4069-a64a-8f5e8c9a2afb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:07.826418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0688b6f5-882f-4069-a64a-8f5e8c9a2afb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:07.886992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0688b6f5-882f-4069-a64a-8f5e8c9a2afb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Going to try to start instance {{(pid=128924) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 06:48:07.938755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0688b6f5-882f-4069-a64a-8f5e8c9a2afb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action" status: 202 len: 0 microversion: 2.1 time: 0.123607 May 11 06:48:07.939989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 504/966] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:48:07 2022] POST /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:48:07.948991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:07.951590 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:07.958182 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:07.958856 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:07.959796 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:07.960820 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:08.129281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:08.137393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ceb039d3-f8d2-427a-b68e-cd95766c9d11 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1663 microversion: 2.1 time: 0.193162 May 11 06:48:08.137976 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 463/967] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:07 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:09.155583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:09.156284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:09.162419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:09.162870 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:09.164197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:09.164634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:09.292788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:09.300218 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0585cda1-1937-4fe7-9cdf-d01aaf25abd2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1663 microversion: 2.1 time: 0.149373 May 11 06:48:09.300774 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 505/968] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:09 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:10.317373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:10.318078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:10.326724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:10.327159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:10.327966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:10.328400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:10.459475 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:10.466724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-45652b33-8648-4f07-b417-dbe519f60397 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1667 microversion: 2.1 time: 0.153365 May 11 06:48:10.467304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 464/969] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:10 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:11.408960 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1990990527", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-438922881", "security_groups": [{"name": "tempest-secgroup-smoke-56965260"}], "networks": [{"uuid": "a0c97def-afee-473f-bd6f-28ea4388bdaf"}], "block_device_mapping_v2": [{"uuid": "627777a5-4523-41c7-babb-5e3ae9c62d43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:11.527631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] validate_networks() for [('a0c97def-afee-473f-bd6f-28ea4388bdaf', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:48:11.896745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:48:11.897161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:48:11.897636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:48:11.898717 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:48:11.899165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:48:11.909163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:11.909663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:11.910505 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:11.910931 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:11.927583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Getting quotas for project e6758effb73344c895a7ed675378f8df. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:48:11.931448 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Getting quotas for user f0b99029c246448da0a2d0e26a16f43d and project e6758effb73344c895a7ed675378f8df. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:48:11.986536 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:48:11.988629 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='627777a5-4523-41c7-babb-5e3ae9c62d43',volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:48:12.112692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5a547d36-cec2-4f14-a051-5cbce3a31355 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.707675 May 11 06:48:12.116930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 506/970] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:48:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:48:12.123053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-e84a7767-a06d-4fce-8f32-3ba43aafb23c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:12.123711 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-e84a7767-a06d-4fce-8f32-3ba43aafb23c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:12.177394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-e84a7767-a06d-4fce-8f32-3ba43aafb23c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:12.183701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-e84a7767-a06d-4fce-8f32-3ba43aafb23c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1088 microversion: 2.1 time: 0.064396 May 11 06:48:12.184272 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 465/971] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:12 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:13.202492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:13.203478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:13.209731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:13.210193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:13.211135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:13.211605 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:13.303782 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:13.313821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5eb46d73-16da-4fa1-9a1d-cbb664b31cee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1204 microversion: 2.1 time: 0.116272 May 11 06:48:13.314399 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 507/972] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:13 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1204 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:14.331738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:14.332464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:14.340123 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:14.340657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:14.341507 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:14.341953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:14.559037 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:14.566399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-676002c7-9e1c-4422-8f89-5d3d7de93e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.238521 May 11 06:48:14.566964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 466/973] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:14 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:14.673901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-71acde4b-2236-4f12-ac5f-551539c861a1 req-d18068ff-ca15-4406-addd-130f9ba33f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:14.688356 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-71acde4b-2236-4f12-ac5f-551539c861a1 req-d18068ff-ca15-4406-addd-130f9ba33f92 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:14.688831 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-71acde4b-2236-4f12-ac5f-551539c861a1 req-d18068ff-ca15-4406-addd-130f9ba33f92 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:14.700620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-71acde4b-2236-4f12-ac5f-551539c861a1 req-d18068ff-ca15-4406-addd-130f9ba33f92 service nova] Creating event network-changed:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:48:14.705385 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-71acde4b-2236-4f12-ac5f-551539c861a1 req-d18068ff-ca15-4406-addd-130f9ba33f92 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041755 May 11 06:48:14.705991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 508/974] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:15.583850 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:15.584463 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:15.590855 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:15.591349 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:15.592127 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:15.592567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:15.786005 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:15.794832 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f4f5f2b6-d012-4978-a134-855797383320 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.214955 May 11 06:48:15.802323 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 467/975] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:15 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:16.812469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:16.813076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:16.819091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:16.819565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:16.820318 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:16.820750 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:16.951365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:16.958657 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b50e567c-dc89-47da-b57a-466b52a7202e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.151003 May 11 06:48:16.959234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 509/976] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:16 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:17.975321 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:17.976464 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:17.982659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:17.983097 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:17.983894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:17.984323 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:18.109928 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:18.117757 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-22b748c8-4d13-42d5-9068-1f359003a09a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.146226 May 11 06:48:18.118326 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 468/977] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:17 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:19.058606 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-563829141", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340440310", "security_groups": [{"name": "tempest-secgroup-smoke-2049296380"}], "block_device_mapping_v2": [{"uuid": "a81140c5-4cee-46e3-a3ca-d57f4723d54d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:19.134376 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:19.134980 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:19.141263 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:19.141704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:19.142460 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:19.142885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:19.169649 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] validate_networks() for [('29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:48:19.360965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:19.369384 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9faf2c00-356a-4e19-bd05-4b4885099726 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.239152 May 11 06:48:19.369893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 469/978] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:19 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:48:19.606284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:48:19.606729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:48:19.607206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:48:19.607636 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:48:19.608050 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:48:19.617235 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:19.617685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:19.618476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:19.618911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:19.635061 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:48:19.638958 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for user 94cdac893464447ea8753d29ac7c629b and project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:48:19.693414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:48:19.695585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a81140c5-4cee-46e3-a3ca-d57f4723d54d',volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:48:19.816016 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3ca90889-e513-480b-8d18-97e7addaa1f9 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.761697 May 11 06:48:19.816650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 510/979] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:48:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:48:19.826948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8bc0fdbc-7e7f-4e02-9dc6-41a9d005b4cc tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:19.827592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8bc0fdbc-7e7f-4e02-9dc6-41a9d005b4cc tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:19.878682 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8bc0fdbc-7e7f-4e02-9dc6-41a9d005b4cc tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:19.885115 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8bc0fdbc-7e7f-4e02-9dc6-41a9d005b4cc tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1094 microversion: 2.1 time: 0.062369 May 11 06:48:19.885679 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 470/980] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:19 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:20.386095 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:20.386706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:20.392746 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:20.393196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:20.393953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:20.394390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:20.525273 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:20.532476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9b84e2b0-5576-456d-a6dc-c1c1556f6c8c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.150682 May 11 06:48:20.533038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 511/981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:20 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:20.902470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d921e0f5-ae9e-47f6-bb88-b27d75dcdcf2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:20.903112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d921e0f5-ae9e-47f6-bb88-b27d75dcdcf2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:20.955536 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d921e0f5-ae9e-47f6-bb88-b27d75dcdcf2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:20.962947 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d921e0f5-ae9e-47f6-bb88-b27d75dcdcf2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1094 microversion: 2.1 time: 0.065024 May 11 06:48:20.963532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 471/982] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:20 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:21.549558 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:21.550164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:21.557086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:21.557538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:21.558300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:21.558729 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:21.684848 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:21.692065 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d03a1154-eaa5-4ab1-8927-c78779abb6b6 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.146362 May 11 06:48:21.692625 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 512/983] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:21 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:21.979814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-085d14bf-a897-4c1e-9d74-41464358ec01 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:21.980421 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-085d14bf-a897-4c1e-9d74-41464358ec01 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:22.035337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-085d14bf-a897-4c1e-9d74-41464358ec01 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:22.042927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-085d14bf-a897-4c1e-9d74-41464358ec01 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1094 microversion: 2.1 time: 0.067476 May 11 06:48:22.043518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 472/984] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:21 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:22.709076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:22.709627 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:22.716396 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:22.716842 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:22.717592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:22.718027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:22.849650 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:22.857694 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c2523077-7c4e-467a-aa89-6c1f41126ea4 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.152539 May 11 06:48:22.858244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 513/985] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:22 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:23.059705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5cec80db-67c5-4c74-b21e-ccc72ad6d8b2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:23.060270 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5cec80db-67c5-4c74-b21e-ccc72ad6d8b2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:23.115194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5cec80db-67c5-4c74-b21e-ccc72ad6d8b2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:23.123531 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5cec80db-67c5-4c74-b21e-ccc72ad6d8b2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1094 microversion: 2.1 time: 0.067659 May 11 06:48:23.124337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 473/986] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:23 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:23.873913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:23.874589 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:23.880968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:23.881420 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:23.882678 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:23.883115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:24.012908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:24.020121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-662ee30c-6ef2-455a-bb3d-0554dda611d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.150093 May 11 06:48:24.020681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 514/987] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:23 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:24.141462 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:24.141998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:24.148309 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:24.148751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:24.149505 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:24.149929 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:24.209020 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:24.216145 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9cdb25c1-38e8-45bc-841e-b716ac8c7881 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1144 microversion: 2.1 time: 0.078591 May 11 06:48:24.216704 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 474/988] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:24 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:25.036446 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:25.039030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:25.046236 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:25.046995 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:25.049663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:25.050494 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:25.182403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-d341defd-ae71-4897-bdd5-1d50c3e16daa req-1c94ae6c-7aef-4fd0-8b3c-4534696ef245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "name": "network-vif-plugged", "status": "completed", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:25.193083 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-d341defd-ae71-4897-bdd5-1d50c3e16daa req-1c94ae6c-7aef-4fd0-8b3c-4534696ef245 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:25.193788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-d341defd-ae71-4897-bdd5-1d50c3e16daa req-1c94ae6c-7aef-4fd0-8b3c-4534696ef245 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:25.208984 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-d341defd-ae71-4897-bdd5-1d50c3e16daa req-1c94ae6c-7aef-4fd0-8b3c-4534696ef245 service nova] Creating event network-vif-plugged:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:48:25.215582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-d341defd-ae71-4897-bdd5-1d50c3e16daa req-1c94ae6c-7aef-4fd0-8b3c-4534696ef245 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 May 11 06:48:25.216289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 475/989] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:48:25.232920 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:25.233615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:25.239797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:25.240241 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:25.241007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:25.241425 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:25.263428 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:25.272115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0303d16-8d74-4649-944a-5fd5f5e6b6b0 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.239349 May 11 06:48:25.274135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 515/990] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:25 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:25.336869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:25.344073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-be29294a-fdb6-484b-b010-dc4f51b78f99 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1210 microversion: 2.1 time: 0.115499 May 11 06:48:25.344656 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 476/991] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:25 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:48:26.290830 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:26.291413 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:26.298077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:26.298523 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:26.299371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:26.299812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:26.361294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:26.361941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:26.368307 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:26.368751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:26.369522 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:26.369955 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:26.648884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:26.654280 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:26.656564 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-519b73d7-f395-4342-a8d3-a3e9add35f5f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.299036 May 11 06:48:26.657529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 477/992] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:26 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:48:26.670474 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9ac27ff8-83a3-4a8b-a4d4-4fa2c004f0c3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1258 microversion: 2.1 time: 0.384162 May 11 06:48:26.671028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 516/993] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:26 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1258 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:26.934479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-84c53cbf-677d-4977-b23c-bd4ec7192ceb req-7cd7fead-28c2-4bce-a5e5-67c6485cd284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2605ddbc-2797-403c-937d-fa10bb1df1b8", "tag": "49dd66e4-b55f-46a8-b872-9c0eaabb296f"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:26.950323 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-84c53cbf-677d-4977-b23c-bd4ec7192ceb req-7cd7fead-28c2-4bce-a5e5-67c6485cd284 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:26.950771 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-84c53cbf-677d-4977-b23c-bd4ec7192ceb req-7cd7fead-28c2-4bce-a5e5-67c6485cd284 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:26.963437 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-84c53cbf-677d-4977-b23c-bd4ec7192ceb req-7cd7fead-28c2-4bce-a5e5-67c6485cd284 service nova] Creating event network-changed:49dd66e4-b55f-46a8-b872-9c0eaabb296f for instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 on hv-cinder-80475 May 11 06:48:26.970222 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-84c53cbf-677d-4977-b23c-bd4ec7192ceb req-7cd7fead-28c2-4bce-a5e5-67c6485cd284 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039352 May 11 06:48:26.971071 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 478/994] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:27.673714 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:27.674405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:27.680769 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.681217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:27.681980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.683059 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:27.688517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:27.689362 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:27.696757 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.697205 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:27.698187 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.698622 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:27.917175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:27.920817 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:27.924531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a40acfeb-f670-49ad-bb19-a2f70be2f338 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.254636 May 11 06:48:27.925105 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 517/995] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:27 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:27.928219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7f6ac9dd-2a1b-4734-b366-f4d0b6aa1bd3 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1441 microversion: 2.1 time: 0.243871 May 11 06:48:27.928788 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 479/996] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:27 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1441 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:48:27.943483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:27.944086 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:27.950128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.950575 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:27.951371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:27.951806 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:28.079607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:28.086783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9c4fec3e-1e3d-48f0-aee8-28da40cfebd9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1441 microversion: 2.1 time: 0.146920 May 11 06:48:28.087365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 518/997] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:27 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1441 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:28.941383 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:28.941994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:28.948563 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:28.949282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:28.950057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:28.950487 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:29.153857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:29.161411 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-70e2f8fb-6222-4cb8-8633-6a76401ab6a8 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.223874 May 11 06:48:29.161975 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 480/998] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:28 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:29.919773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-20a323c6-b69c-49ff-943a-99dc9a126170 req-2f14968b-4fc6-4700-8d7e-227102fba0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:29.928612 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-20a323c6-b69c-49ff-943a-99dc9a126170 req-2f14968b-4fc6-4700-8d7e-227102fba0bc service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:29.929217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-20a323c6-b69c-49ff-943a-99dc9a126170 req-2f14968b-4fc6-4700-8d7e-227102fba0bc service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:29.941220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-20a323c6-b69c-49ff-943a-99dc9a126170 req-2f14968b-4fc6-4700-8d7e-227102fba0bc service nova] Creating event network-changed:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:48:29.946553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-20a323c6-b69c-49ff-943a-99dc9a126170 req-2f14968b-4fc6-4700-8d7e-227102fba0bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030529 May 11 06:48:29.947237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 519/999] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:30.178871 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:30.179525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:30.186030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:30.186698 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:30.187500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:30.187932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:30.384349 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:30.392243 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c5e94f31-8345-4035-a737-06d9b82d0776 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.217192 May 11 06:48:30.393171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 481/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:30 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:31.410858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:31.411590 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:31.418309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:31.418763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:31.419557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:31.420000 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:31.557452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:31.564734 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-156634df-a115-4233-bfc7-1511822b12ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.158613 May 11 06:48:31.565302 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 520/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:31 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:32.582270 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:32.582663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:32.588995 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:32.589443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:32.590209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:32.590640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:32.718957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:32.726793 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f2784343-0f94-40aa-acbb-b033e8affeaa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.148749 May 11 06:48:32.727378 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 482/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:32 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:33.744298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:33.744893 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:33.751127 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:33.751607 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:33.752390 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:33.752812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:33.885376 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:33.892639 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-14affda4-d256-42ba-a0fc-eb354c583b1d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.152948 May 11 06:48:33.893205 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 521/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:33 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:34.909843 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:34.910443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:34.916734 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:34.917174 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:34.917922 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:34.918347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:35.044651 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:35.052026 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d20a89b9-5197-4fd2-b3c3-d01ab3f15ffa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.146028 May 11 06:48:35.052578 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 483/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:34 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:36.068886 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:36.069549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:36.076211 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:36.076663 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:36.077418 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:36.077861 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:36.205658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:36.213359 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b832bc08-9e7a-4d77-95d2-cef4a385f802 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.148326 May 11 06:48:36.213918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 522/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:36 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:37.230618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:37.231225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:37.237669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:37.238115 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:37.238894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:37.239353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:37.371803 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:37.379075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0c33dc6e-c10d-450f-8e1b-b2648ee61f34 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.152284 May 11 06:48:37.379619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 484/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:37 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:38.395058 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:38.395677 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:38.402826 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:38.403288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:38.404069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:38.404496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:38.535028 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:38.542693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7dcb3da9-be4f-4c82-9de4-2b5b71618a62 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.151552 May 11 06:48:38.543253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 523/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:38 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:39.276513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-fe7c3294-0e78-47c2-b09f-7761e28ed0d1 req-814d3475-9369-4e78-af78-dd609f9fb73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2605ddbc-2797-403c-937d-fa10bb1df1b8", "name": "network-vif-plugged", "status": "completed", "tag": "49dd66e4-b55f-46a8-b872-9c0eaabb296f"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:39.285086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-fe7c3294-0e78-47c2-b09f-7761e28ed0d1 req-814d3475-9369-4e78-af78-dd609f9fb73f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:39.285245 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-fe7c3294-0e78-47c2-b09f-7761e28ed0d1 req-814d3475-9369-4e78-af78-dd609f9fb73f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:39.295941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-fe7c3294-0e78-47c2-b09f-7761e28ed0d1 req-814d3475-9369-4e78-af78-dd609f9fb73f service nova] Creating event network-vif-plugged:49dd66e4-b55f-46a8-b872-9c0eaabb296f for instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 on hv-cinder-80475 May 11 06:48:39.300827 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-fe7c3294-0e78-47c2-b09f-7761e28ed0d1 req-814d3475-9369-4e78-af78-dd609f9fb73f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028670 May 11 06:48:39.301418 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 485/1008] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:39.559621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:39.560224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:39.566881 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:39.567455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:39.568158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:39.568587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:39.716006 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:39.723462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ee400de7-e149-41b7-b5c7-5875e2e0e8fa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.167817 May 11 06:48:39.724123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 524/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:39 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:40.741320 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:40.741963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:40.748043 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:40.748495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:40.749275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:40.749710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:40.880408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:40.888132 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8be225a4-8550-402f-b7af-ce4ba32ee51c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1266 microversion: 2.1 time: 0.151574 May 11 06:48:40.888723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 486/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:40 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:41.904621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:41.905230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:41.911808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:41.912253 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:41.913013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:41.914094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:42.042077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:42.049414 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-00c2d07a-f0c0-49f7-90b6-079655777b53 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1454 microversion: 2.1 time: 0.148690 May 11 06:48:42.049974 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 525/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:41 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:42.066121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:42.066724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:42.072952 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:42.073413 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:42.074430 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:42.074857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:42.199996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:42.207242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fca201b7-80a4-41ee-8543-d71b439c307c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1454 microversion: 2.1 time: 0.145756 May 11 06:48:42.207828 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 487/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:42 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:48:44.132492 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-638fd8df-733e-476c-a194-52a264cf2d07 req-41331a0a-11bf-4fe2-8d7d-08b57f8691a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2605ddbc-2797-403c-937d-fa10bb1df1b8", "tag": "49dd66e4-b55f-46a8-b872-9c0eaabb296f"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:44.140781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-638fd8df-733e-476c-a194-52a264cf2d07 req-41331a0a-11bf-4fe2-8d7d-08b57f8691a1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.141226 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-638fd8df-733e-476c-a194-52a264cf2d07 req-41331a0a-11bf-4fe2-8d7d-08b57f8691a1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.152731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-638fd8df-733e-476c-a194-52a264cf2d07 req-41331a0a-11bf-4fe2-8d7d-08b57f8691a1 service nova] Creating event network-changed:49dd66e4-b55f-46a8-b872-9c0eaabb296f for instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 on hv-cinder-80475 May 11 06:48:44.157797 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-638fd8df-733e-476c-a194-52a264cf2d07 req-41331a0a-11bf-4fe2-8d7d-08b57f8691a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029038 May 11 06:48:44.158755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 526/1013] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:44.303119 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:44.304653 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:44.311172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.311643 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.312660 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.313021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.343428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6957dbe4-d34a-40d4-afb6-10e184974b94 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044505 May 11 06:48:44.344207 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 488/1014] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:48:44 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:48:44.404190 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:44.405103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:44.412076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.412863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.413682 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.414130 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.441738 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:48:44.535163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-246492a8-2d78-47a9-b16f-3cda6ea3f3a2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 204 len: 0 microversion: 2.1 time: 0.135626 May 11 06:48:44.536238 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 527/1015] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:48:44 2022] DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:48:44.546089 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:44.546691 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:44.552618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.553063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.554402 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:44.554834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:44.689064 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:44.696524 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0dd87176-b80d-4688-8edb-0abb380f1d0c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1673 microversion: 2.1 time: 0.154675 May 11 06:48:44.697428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 489/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:44 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:45.714951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:45.715668 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:45.721924 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:45.722369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:45.723592 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:45.724410 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:45.848578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:45.856344 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b569201f-1f95-491f-ac08-3a4c86f1ea97 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1673 microversion: 2.1 time: 0.146132 May 11 06:48:45.856898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 528/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:45 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:46.874402 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:46.875169 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:46.881588 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:46.882106 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:46.883615 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:46.884119 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:47.112073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:47.119847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-32d61ad0-e902-44c3-bd37-d21693384563 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1673 microversion: 2.1 time: 0.249370 May 11 06:48:47.120424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 490/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:46 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:48.007895 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-7cc079cf-6f23-4bcb-a24d-e51006f5bf0e req-b6c54d9a-8ace-4ff4-b89c-09f4257d2390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319d4a2d-cf16-4a05-824b-f0e457578c58", "name": "network-vif-deleted", "tag": "3abf2078-858c-4ccf-a7cb-d16309a1b893"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:48.016455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7cc079cf-6f23-4bcb-a24d-e51006f5bf0e req-b6c54d9a-8ace-4ff4-b89c-09f4257d2390 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:48.016897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7cc079cf-6f23-4bcb-a24d-e51006f5bf0e req-b6c54d9a-8ace-4ff4-b89c-09f4257d2390 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:48.028342 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-7cc079cf-6f23-4bcb-a24d-e51006f5bf0e req-b6c54d9a-8ace-4ff4-b89c-09f4257d2390 service nova] Creating event network-vif-deleted:3abf2078-858c-4ccf-a7cb-d16309a1b893 for instance 319d4a2d-cf16-4a05-824b-f0e457578c58 on hv-cinder-80475 May 11 06:48:48.033132 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-7cc079cf-6f23-4bcb-a24d-e51006f5bf0e req-b6c54d9a-8ace-4ff4-b89c-09f4257d2390 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028925 May 11 06:48:48.033788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 529/1019] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:48.137540 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:48.138151 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:48.146135 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:48.146590 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:48.147671 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:48.149223 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:48.184620 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:48.185187 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:48.185647 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lazy-loading 'fault' on Instance uuid 319d4a2d-cf16-4a05-824b-f0e457578c58 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:48:48.227244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:48.234543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-535e3dc4-042a-4f56-b1c3-9e63410df10a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 200 len: 1327 microversion: 2.1 time: 0.101559 May 11 06:48:48.235120 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 491/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:48 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:49.252697 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:49.253317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:49.259531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:49.259986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:49.260756 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:49.261199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:49.274165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 HTTP/1.1 May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:48:49.275813 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:48:49.277348 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '319d4a2d-cf16-4a05-824b-f0e457578c58'} May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:48:49.278187 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:48:49.279865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:48:49.281781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:48:49.281781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8a333133-9705-4a34-9943-194552990c7f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 404 len: 111 microversion: 2.1 time: 0.029369 May 11 06:48:49.281781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 530/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:49 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:48:49.285927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ebf73df5-2183-448e-afe5-f8020b850613 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '.version_select at 0x7fc5cdddd8b0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:49.302954 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ebf73df5-2183-448e-afe5-f8020b850613 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973683960" status: 202 len: 0 microversion: 2.1 time: 0.020752 May 11 06:48:49.303529 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 492/1022] 10.222.0.64 () {58 vars in 1220 bytes} [Wed May 11 06:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973683960 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:48:49.915136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e101ea25-5915-40c5-89d1-b69221538c48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: .version_select at 0x7fc5c8bc15e0>, body: {"keypair": {"name": "tempest-keypair-1112048644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEA04zOF3RcEuGPdlDSTYGvpOFNSJZgLe8ZuHR6b56CDpi7xPplqoXQyo/j7r4REI9HdbYqvGMuLqjMtXlNGK7tAiDgCkjzDIZu0vEKqJZRSpDArtatISUqnapWBFLdQw=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:49.928827 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-e101ea25-5915-40c5-89d1-b69221538c48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for project ec5def7947c243698109bfc891b0992f. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:48:49.932581 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-e101ea25-5915-40c5-89d1-b69221538c48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for user 4974777a05b64dbcb3550b74b9f39dee and project ec5def7947c243698109bfc891b0992f. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:48:49.954213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e101ea25-5915-40c5-89d1-b69221538c48 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043076 May 11 06:48:49.954795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 531/1023] 10.222.0.64 () {60 vars in 1158 bytes} [Wed May 11 06:48:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:48:51.206818 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1062205881", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6742b34a-d638-418c-8bcb-aa221cf053c2"}], "security_groups": [{"name": "tempest-securitygroup--1915642311"}], "key_name": "tempest-keypair-1112048644", "user_data": "}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:51.462684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] validate_networks() for [('6742b34a-d638-418c-8bcb-aa221cf053c2', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:48:51.823696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:48:51.824114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:48:51.824841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:48:51.825241 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:48:51.825684 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:48:51.834132 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:51.834575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:51.835400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:51.836406 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:51.852840 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for project ec5def7947c243698109bfc891b0992f. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:48:51.856677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Getting quotas for user 4974777a05b64dbcb3550b74b9f39dee and project ec5def7947c243698109bfc891b0992f. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:48:51.867666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:48:51.869856 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:48:51.914472 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-22ffc328-9c0e-48e7-9770-7cf0d82d31cd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712413 May 11 06:48:51.915035 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 493/1024] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:48:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:48:51.925452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-052fafc8-7c39-4a3e-a9a9-7e765031e7c4 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:51.926071 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-052fafc8-7c39-4a3e-a9a9-7e765031e7c4 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:51.986799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-052fafc8-7c39-4a3e-a9a9-7e765031e7c4 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:51.993884 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-052fafc8-7c39-4a3e-a9a9-7e765031e7c4 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1238 microversion: 2.1 time: 0.072822 May 11 06:48:51.994449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 532/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:51 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:53.011549 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:53.012319 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:53.018582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:53.019098 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:53.020131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:53.020720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:53.102894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:53.110446 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-19d4b9a0-bc20-4981-ad6f-e2305bd45727 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1308 microversion: 2.1 time: 0.103867 May 11 06:48:53.115714 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 494/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:53 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:54.128316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:54.129089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:54.136112 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:54.136497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:54.137259 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:54.137692 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:54.341324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:54.349521 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f44f7605-a11c-4b1d-9593-1182a7bd43b8 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.225124 May 11 06:48:54.350106 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 533/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:54 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:54.544189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-1e92e77a-1875-4612-90ed-b7160c880f43 req-e66a7618-18a7-4c94-a3b3-1eee83d9ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ff101-4c9f-467d-b213-df4e0096ab6c", "tag": "591127bb-bab1-4f0c-a228-34f75e6a053f"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:48:54.553068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-1e92e77a-1875-4612-90ed-b7160c880f43 req-e66a7618-18a7-4c94-a3b3-1eee83d9ddb1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:54.553513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-1e92e77a-1875-4612-90ed-b7160c880f43 req-e66a7618-18a7-4c94-a3b3-1eee83d9ddb1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:54.564772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-1e92e77a-1875-4612-90ed-b7160c880f43 req-e66a7618-18a7-4c94-a3b3-1eee83d9ddb1 service nova] Creating event network-changed:591127bb-bab1-4f0c-a228-34f75e6a053f for instance f79ff101-4c9f-467d-b213-df4e0096ab6c on hv-cinder-80475 May 11 06:48:54.569528 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-1e92e77a-1875-4612-90ed-b7160c880f43 req-e66a7618-18a7-4c94-a3b3-1eee83d9ddb1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029448 May 11 06:48:54.570124 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 495/1028] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:48:55.366033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:55.366635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:55.372635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:55.373081 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:55.373829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:55.374254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:55.505165 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:55.512443 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6e4d7643-db9e-458b-bbca-769f335561e0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.150288 May 11 06:48:55.513038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 534/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:55 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:56.530191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:56.530900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:56.536978 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:56.537428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:56.538195 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:56.538631 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:56.669919 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:56.677045 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ada73fec-4ae9-4848-9cea-fa55098ff550 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.151823 May 11 06:48:56.677597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 496/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:56 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:57.694201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:57.694740 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:57.702041 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:57.702472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:57.703316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:57.703856 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:57.841404 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:57.848684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b65fd018-3415-45ed-a49d-6bc0c6a81439 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.158389 May 11 06:48:57.849247 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 535/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:57 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:48:58.865345 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:48:58.865894 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:48:58.872445 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:58.872893 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:58.873674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:48:58.874114 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:48:59.001990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:48:59.009198 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0a682e56-b3b8-48a1-b1d4-c3fcd9ec334f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.147811 May 11 06:48:59.009751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 497/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:48:58 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:49:00.026621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:00.027203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:00.033539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:00.033983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:00.034732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:00.035161 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:00.159598 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:49:00.167285 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d4bc7d01-2145-44df-a622-4d160e35485a tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.144499 May 11 06:49:00.167855 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 536/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:49:00 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:49:01.184620 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:01.185227 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:01.191542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:01.191990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:01.192751 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:01.193186 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:01.326841 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:49:01.334010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7020cc6f-2149-402c-a415-a616850a54da tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.153909 May 11 06:49:01.334557 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 498/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:49:01 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:49:01.374847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-41485822-64b8-4ba0-8e88-b3e58d7f4117 req-0f6ed440-2390-4332-858b-ac383a32b1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ff101-4c9f-467d-b213-df4e0096ab6c", "name": "network-vif-plugged", "status": "completed", "tag": "591127bb-bab1-4f0c-a228-34f75e6a053f"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:49:01.383554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-41485822-64b8-4ba0-8e88-b3e58d7f4117 req-0f6ed440-2390-4332-858b-ac383a32b1b5 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:01.384048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-41485822-64b8-4ba0-8e88-b3e58d7f4117 req-0f6ed440-2390-4332-858b-ac383a32b1b5 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:01.396773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-41485822-64b8-4ba0-8e88-b3e58d7f4117 req-0f6ed440-2390-4332-858b-ac383a32b1b5 service nova] Creating event network-vif-plugged:591127bb-bab1-4f0c-a228-34f75e6a053f for instance f79ff101-4c9f-467d-b213-df4e0096ab6c on hv-cinder-80475 May 11 06:49:01.402792 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-41485822-64b8-4ba0-8e88-b3e58d7f4117 req-0f6ed440-2390-4332-858b-ac383a32b1b5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 May 11 06:49:01.403605 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 537/1035] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:49:02.351621 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:02.352236 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:02.358654 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:02.359109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:02.359910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:02.360346 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:02.491377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:49:02.499158 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-856007dd-6116-4028-b70f-1393eb8fb199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1364 microversion: 2.1 time: 0.151459 May 11 06:49:02.499774 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 499/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:49:02 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:49:03.518460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:03.519195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:03.525752 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:03.526810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:03.527613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:03.528057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:03.654837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:49:03.662019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8b4839d9-febe-4a76-a7ce-9f8201e9600d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1549 microversion: 2.1 time: 0.147881 May 11 06:49:03.662584 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 538/1037] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:49:03 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:49:03.677833 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:03.678358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:03.685203 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:03.685592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:03.686354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:03.686792 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:03.762665 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-66054bf0-2c72-4024-bf2e-fa208f2e8949 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088636 May 11 06:49:03.763241 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 500/1038] 10.222.0.64 () {58 vars in 1274 bytes} [Wed May 11 06:49:03 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:04.717409 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-48c6ff58-8e14-4ee3-a0b7-2199f2df4356 req-51027060-b2b7-47c3-9911-9e8445108cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ff101-4c9f-467d-b213-df4e0096ab6c", "tag": "591127bb-bab1-4f0c-a228-34f75e6a053f"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:49:04.725786 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-48c6ff58-8e14-4ee3-a0b7-2199f2df4356 req-51027060-b2b7-47c3-9911-9e8445108cf1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:04.726306 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-48c6ff58-8e14-4ee3-a0b7-2199f2df4356 req-51027060-b2b7-47c3-9911-9e8445108cf1 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:04.737821 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-48c6ff58-8e14-4ee3-a0b7-2199f2df4356 req-51027060-b2b7-47c3-9911-9e8445108cf1 service nova] Creating event network-changed:591127bb-bab1-4f0c-a228-34f75e6a053f for instance f79ff101-4c9f-467d-b213-df4e0096ab6c on hv-cinder-80475 May 11 06:49:04.742742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-48c6ff58-8e14-4ee3-a0b7-2199f2df4356 req-51027060-b2b7-47c3-9911-9e8445108cf1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029184 May 11 06:49:04.743532 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 539/1039] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:40.648580 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:40.649149 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:40.655749 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:40.656202 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:40.656969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:40.657405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:40.679073 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d7c448dc-ebd3-4c1b-bccb-9583e556305d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035107 May 11 06:49:40.679654 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 501/1040] 10.222.0.64 () {58 vars in 1247 bytes} [Wed May 11 06:49:40 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:41.984933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23760ede-54a2-403c-97c1-4bf182e7caad"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:49:41.986108 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:41.992166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:41.992609 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:41.993360 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:41.993790 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:42.342389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8b7ed513-14bc-4604-8812-57409a5009b6 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362061 May 11 06:49:42.343046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 540/1041] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:49:41 2022] POST /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:49.823508 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:49.824740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:49.832068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:49.832516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:49.833300 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:49.833736 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:49.864752 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-cae05d3f-c92a-4366-8592-4832cc143da2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 May 11 06:49:49.865431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 502/1042] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:49:49 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:49.876333 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:49.876921 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:49.883386 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:49.883878 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:49.884652 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:49.885094 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:49.913158 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62251fd8-4ef2-44f8-ab01-c6ca3fb76981 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad" status: 200 len: 194 microversion: 2.1 time: 0.041745 May 11 06:49:49.913735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 541/1043] 10.222.0.64 () {58 vars in 1412 bytes} [Wed May 11 06:49:49 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:51.226048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99a070bb-8fb4-42a8-afa0-29489d4b3399"}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:49:51.227178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:51.234809 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:51.235256 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:51.236236 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:51.236666 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:51.531457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f7d3ad37-60d6-4fbc-8d5f-4a2785983dbb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "POST /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309427 May 11 06:49:51.532049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 503/1044] 10.222.0.64 () {60 vars in 1322 bytes} [Wed May 11 06:49:51 2022] POST /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:49:58.997048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:58.998039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:59.004486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.004930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.005690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.006123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.034978 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2af5e701-7af7-4739-99b4-feca31d64edd tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041854 May 11 06:49:59.035552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 542/1045] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:49:58 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:59.185435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:59.186038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:59.192298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.192741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.193510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.193939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.222209 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6fc1a521-de95-4409-aa54-3ed3e0011db0 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad" status: 200 len: 194 microversion: 2.1 time: 0.042222 May 11 06:49:59.222777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 504/1046] 10.222.0.64 () {58 vars in 1412 bytes} [Wed May 11 06:49:59 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:49:59.232217 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:49:59.232704 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:49:59.238502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.238949 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.239734 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:49:59.240166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:49:59.315688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lazy-loading 'services' on Instance uuid f79ff101-4c9f-467d-b213-df4e0096ab6c {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:49:59.384354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-63a7d6f3-4e4a-4f0b-ba11-8fb1d2304601 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad" status: 202 len: 0 microversion: 2.1 time: 0.155806 May 11 06:49:59.385148 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 543/1047] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:49:59 2022] DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/23760ede-54a2-403c-97c1-4bf182e7caad => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:50:01.543525 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:01.543999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:01.550354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:01.550796 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:01.551595 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:01.552022 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:01.580125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-27b2aadd-1d3c-4630-8094-9035bf7f4c5f tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/99a070bb-8fb4-42a8-afa0-29489d4b3399" status: 200 len: 194 microversion: 2.1 time: 0.040981 May 11 06:50:01.580687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 505/1048] 10.222.0.64 () {58 vars in 1412 bytes} [Wed May 11 06:50:01 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/99a070bb-8fb4-42a8-afa0-29489d4b3399 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:01.590851 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:01.591460 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:01.597977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:01.598426 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:01.599193 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:01.599671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:01.677154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lazy-loading 'services' on Instance uuid f79ff101-4c9f-467d-b213-df4e0096ab6c {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:50:01.745256 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-567727e2-2173-4007-960f-52dfbbd39e52 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/99a070bb-8fb4-42a8-afa0-29489d4b3399" status: 202 len: 0 microversion: 2.1 time: 0.158677 May 11 06:50:01.745874 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 544/1049] 10.222.0.64 () {58 vars in 1415 bytes} [Wed May 11 06:50:01 2022] DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments/99a070bb-8fb4-42a8-afa0-29489d4b3399 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:50:02.896510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:02.897422 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:02.903618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:02.904063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:02.904819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:02.905257 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:02.932571 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9fa448da-77ab-44b0-ae8a-000f3f0b3916 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039943 May 11 06:50:02.933618 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 506/1050] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:50:02 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:50:03.033321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:03.034329 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:03.040835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.041282 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.042038 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.043015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.070442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f00b3e78-b4a2-425d-9e70-ea1bcdfc7910 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041384 May 11 06:50:03.070980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 545/1051] 10.222.0.64 () {58 vars in 1301 bytes} [Wed May 11 06:50:03 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:50:03.125957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:03.126478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:03.132278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.132723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.133474 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.133907 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.157614 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:50:03.228530 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7d19b724-a738-48c8-9569-7bb3925a0cb2 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 204 len: 0 microversion: 2.1 time: 0.106094 May 11 06:50:03.229324 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 507/1052] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:50:03 2022] DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:50:03.239824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:03.240432 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:03.246541 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.246984 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.247773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:03.248203 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:03.374977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:03.382277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a945a00c-0c70-4c30-a29f-abe13e89c60d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1674 microversion: 2.1 time: 0.146758 May 11 06:50:03.382819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 546/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:03 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:04.399246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:04.399960 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:04.406532 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:04.407061 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:04.407887 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:04.408352 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:04.536355 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:04.544193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4747f589-5db7-46f1-bc28-b9e2b0b9451c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1674 microversion: 2.1 time: 0.149165 May 11 06:50:04.544752 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 508/1054] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:04 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:05.562033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:05.562635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:05.569631 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:05.570077 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:05.570853 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:05.571298 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:05.909917 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:05.917237 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-90cdc014-88bc-4e1b-be06-b23b9c54657c tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1674 microversion: 2.1 time: 0.359681 May 11 06:50:05.918316 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 547/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:05 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1674 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:06.548188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-0963a365-8678-489d-9eb3-43cd12ec9729 req-53d0b738-9f40-4c10-829a-ecf0c6d5b99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ff101-4c9f-467d-b213-df4e0096ab6c", "name": "network-vif-deleted", "tag": "591127bb-bab1-4f0c-a228-34f75e6a053f"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:06.556264 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0963a365-8678-489d-9eb3-43cd12ec9729 req-53d0b738-9f40-4c10-829a-ecf0c6d5b99f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:06.557033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-0963a365-8678-489d-9eb3-43cd12ec9729 req-53d0b738-9f40-4c10-829a-ecf0c6d5b99f service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:06.568335 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-0963a365-8678-489d-9eb3-43cd12ec9729 req-53d0b738-9f40-4c10-829a-ecf0c6d5b99f service nova] Creating event network-vif-deleted:591127bb-bab1-4f0c-a228-34f75e6a053f for instance f79ff101-4c9f-467d-b213-df4e0096ab6c on hv-cinder-80475 May 11 06:50:06.580904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-0963a365-8678-489d-9eb3-43cd12ec9729 req-53d0b738-9f40-4c10-829a-ecf0c6d5b99f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108405 May 11 06:50:06.582127 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 509/1056] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:06.934864 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:06.935419 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:06.941469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:06.941908 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:06.942671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:06.943171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:06.977478 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:06.977925 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:06.978369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lazy-loading 'fault' on Instance uuid f79ff101-4c9f-467d-b213-df4e0096ab6c {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:50:07.025832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974777a05b64dbcb3550b74b9f39dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5def7947c243698109bfc891b0992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:07.033230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-82f993cd-7a7d-47c0-96ea-2bbce428f968 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 200 len: 1328 microversion: 2.1 time: 0.102870 May 11 06:50:07.037772 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 548/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:06 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:08.050931 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:08.051657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:08.057775 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:08.058862 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:08.059658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:08.060103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:08.073573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c HTTP/1.1 May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:50:08.075188 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:08.077220 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'f79ff101-4c9f-467d-b213-df4e0096ab6c'} May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:08.078140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:08.079742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:08.081170 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:08.081170 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-be306e72-951b-4043-91e5-f49c735dc1de tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 404 len: 111 microversion: 2.1 time: 0.030612 May 11 06:50:08.081170 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 510/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:08 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:08.085634 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-80b9db6c-9f68-4d32-b91d-a9aebc9c9976 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '.version_select at 0x7fc5c8d1aa60>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:08.102296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-80b9db6c-9f68-4d32-b91d-a9aebc9c9976 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112048644" status: 202 len: 0 microversion: 2.1 time: 0.020459 May 11 06:50:08.102850 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 549/1059] 10.222.0.64 () {58 vars in 1220 bytes} [Wed May 11 06:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112048644 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:50:10.973152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:10.973635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:10.979943 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:10.980386 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:10.981290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:10.981724 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:10.994570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c HTTP/1.1 May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:50:10.996701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:10.998212 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'f79ff101-4c9f-467d-b213-df4e0096ab6c'} May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:10.998969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:11.001518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:11.001518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8146cb11-31c2-4e72-8fa2-bc3e721678cb tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 404 len: 111 microversion: 2.1 time: 0.028704 May 11 06:50:11.001518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 511/1060] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:50:10 2022] DELETE /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:11.006829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:11.007463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: f79ff101-4c9f-467d-b213-df4e0096ab6c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:11.014572 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:11.015064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:11.015803 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:11.016239 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:11.028962 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c HTTP/1.1 May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:50:11.030553 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.032156 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': 'f79ff101-4c9f-467d-b213-df4e0096ab6c'} May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:11.033063 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. May 11 06:50:11.034583 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:11.035965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance f79ff101-4c9f-467d-b213-df4e0096ab6c could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:11.035965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7a9d0c09-3407-43c6-be0c-89b9f0f74b1d tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c" status: 404 len: 111 microversion: 2.1 time: 0.029388 May 11 06:50:11.035965 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 550/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:11 2022] GET /compute/v2.1/servers/f79ff101-4c9f-467d-b213-df4e0096ab6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:12.160945 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:12.161434 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:12.168221 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:12.168663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:12.169424 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:12.169857 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:12.182597 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 HTTP/1.1 May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:50:12.184157 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.185747 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '319d4a2d-cf16-4a05-824b-f0e457578c58'} May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:12.186658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.188177 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:12.189723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:12.189723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c58923bf-8022-4d5d-80c0-05fd80df6199 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 404 len: 111 microversion: 2.1 time: 0.028353 May 11 06:50:12.189723 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 512/1062] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:50:12 2022] DELETE /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:12.193735 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:12.194456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] [instance: 319d4a2d-cf16-4a05-824b-f0e457578c58] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:12.201003 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:12.201455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:12.202214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:12.202666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:12.216090 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] HTTP exception thrown: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Request method failure captured: May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 HTTP/1.1 May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1ua93D9hPY54ktMm2aHUN3uYIYkOc_iaWyRErnvXT0CUuCg2b4MiU5YpTGVyJNhGJ57PKJhtI30ftCWCB6TbinjNL8yp2ko2ls0wFg-tfMDf2aGmLf9XQMMX-J8DJRbfJ8XY0Zc8mGvTQ0QHU6wsuCQaNKsZIBtP8700TPyrbinPiE May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:50:12.217683 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec5def7947c243698109bfc891b0992f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec5def7947c243698109bfc891b0992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec5def7947c243698109bfc891b0992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: ec5def7947c243698109bfc891b0992f May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1634053691 May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 4974777a05b64dbcb3550b74b9f39dee May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeTestJSON-1634053691-project May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.219222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '319d4a2d-cf16-4a05-824b-f0e457578c58'} May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:12.220168 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. May 11 06:50:12.221644 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:50:12.223107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] Returning 404 to user: Instance 319d4a2d-cf16-4a05-824b-f0e457578c58 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:12.223107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e791286f-6bf6-41f1-8cb4-e02b3a8bfaf9 tempest-AttachVolumeTestJSON-1634053691 tempest-AttachVolumeTestJSON-1634053691-project] 10.222.0.64 "GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58" status: 404 len: 111 microversion: 2.1 time: 0.029164 May 11 06:50:12.223107 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 551/1063] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:12 2022] GET /compute/v2.1/servers/319d4a2d-cf16-4a05-824b-f0e457578c58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:50:28.333958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:28.334600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:28.340991 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:28.341436 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:28.342194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:28.342628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:28.364503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lazy-loading 'flavor' on Instance uuid 876c9add-17b5-422d-8b96-30da512c6d46 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:50:28.434337 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-29d294fe-3d84-4b53-826a-aeceb32b0e2b tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "POST /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46/action" status: 202 len: 0 microversion: 2.1 time: 0.104132 May 11 06:50:28.434921 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 513/1064] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:50:28 2022] POST /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:50:28.443197 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:28.443837 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:28.449815 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:28.450290 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:28.451369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:28.451839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:28.581567 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:28.589008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e253d773-c356-4d25-981e-06dcb4926671 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.149698 May 11 06:50:28.589504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 552/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:28 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:29.606898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:29.607632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:29.613710 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:29.614160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:29.614923 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:29.615390 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:29.743608 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:29.751524 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ded3c410-abf3-48ef-acf0-60ee81b9df97 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.149364 May 11 06:50:29.752088 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 514/1066] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:29 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:30.768788 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:30.769402 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:30.775923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:30.776434 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:30.777839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:30.778476 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:30.921857 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:30.929384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fee13616-43c8-407a-82e2-770c5f0a5898 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.164564 May 11 06:50:30.929977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 553/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:30 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:31.947121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:31.947905 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:31.954963 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:31.955453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:31.956234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:31.956675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:32.090628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:32.098078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d810a520-7ec3-47b0-9371-81efbb20cc3e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.154856 May 11 06:50:32.098636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 515/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:31 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:33.115018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:33.116133 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:33.125245 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:33.127033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:33.128435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:33.129089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:33.285773 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:33.294573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4fd8a52f-304a-4c56-874a-e7559acabbaa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.183969 May 11 06:50:33.298142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 554/1069] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:33 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:34.312653 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:34.313254 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:34.319836 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:34.320279 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:34.321047 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:34.321471 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:34.453598 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:34.460831 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a13d16bc-3d40-4638-b739-388106f999c1 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.153215 May 11 06:50:34.461391 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 516/1070] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:34 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:34.765997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-754452566", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "networks": [{"uuid": "c7951eaf-d227-4a93-9663-83075f8dba8d"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:34.816437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] validate_networks() for [('c7951eaf-d227-4a93-9663-83075f8dba8d', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:50:35.199956 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:50:35.200370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:50:35.201103 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:50:35.201509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:50:35.201916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:50:35.210439 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:35.210876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:35.211700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:35.212131 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:35.228635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Getting quotas for project 3ce3abdf08024c23b5dbe4d353057d94. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:50:35.232473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Getting quotas for user 99d0cd8a42c9463ba9dd90f9fcc10d36 and project 3ce3abdf08024c23b5dbe4d353057d94. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:50:35.242933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:50:35.245202 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:50:35.287477 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [146300b6-7457-464a-9f85-6437e37f24b3] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 11 06:50:35.477638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:35.478184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:35.484456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:35.484903 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:35.485663 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:35.486093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:35.611459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:35.618605 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-8246f594-3b47-4723-8a79-e68390e972fb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.144877 May 11 06:50:35.619165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 517/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:35 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:36.294696 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [146300b6-7457-464a-9f85-6437e37f24b3] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 49542. May 11 06:50:36.298754 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a93cc6d1-9d5c-439a-bf79-260dc2bf5324 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.536629 May 11 06:50:36.299496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 555/1072] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:50:36.309877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-9305768d-2b26-4b8f-b64b-92343bb5f444 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:36.310487 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-9305768d-2b26-4b8f-b64b-92343bb5f444 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:36.361678 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-9305768d-2b26-4b8f-b64b-92343bb5f444 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:36.368142 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-9305768d-2b26-4b8f-b64b-92343bb5f444 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1213 microversion: 2.1 time: 0.062596 May 11 06:50:36.368703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 518/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:36 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:36.636403 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:36.637124 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:36.645919 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:36.646496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:36.647389 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:36.648222 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:36.787480 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:36.795828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4db18b78-117d-4e43-b568-350117a2a21a tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.163854 May 11 06:50:36.796400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 556/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:36 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:37.385431 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:37.386516 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:37.393111 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:37.393561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:37.394372 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:37.394804 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:37.479535 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:37.486884 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-de0833be-2263-43b3-bd7a-a77d66ba0a05 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1273 microversion: 2.1 time: 0.105909 May 11 06:50:37.487478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 519/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:37 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:37.813618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:37.814408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:37.820942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:37.821453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:37.822288 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:37.822795 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:38.011887 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:38.021008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-573e5f9f-c335-4ad7-86a0-c72f76cde6ee tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.211291 May 11 06:50:38.021783 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 557/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:37 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:38.503675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:38.504286 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:38.510501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:38.510935 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:38.511729 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:38.512162 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:38.755381 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:38.762905 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-38606545-5320-4c50-b090-65cb3ac1f796 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.263033 May 11 06:50:38.766342 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 520/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:38 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:39.039645 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:39.040915 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:39.047041 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:39.047656 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:39.048424 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:39.048860 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:39.157225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-ad5e5e66-07db-4961-a290-7b93884bad1c req-83f05db7-5c88-4c23-8b80-bdb090b963e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78e1463-adc1-4efa-913e-9af96e684d68", "tag": "b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:39.169638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-ad5e5e66-07db-4961-a290-7b93884bad1c req-83f05db7-5c88-4c23-8b80-bdb090b963e6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:39.171443 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-ad5e5e66-07db-4961-a290-7b93884bad1c req-83f05db7-5c88-4c23-8b80-bdb090b963e6 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:39.190902 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-ad5e5e66-07db-4961-a290-7b93884bad1c req-83f05db7-5c88-4c23-8b80-bdb090b963e6 service nova] Creating event network-changed:b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74 for instance e78e1463-adc1-4efa-913e-9af96e684d68 on hv-cinder-80475 May 11 06:50:39.196294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-ad5e5e66-07db-4961-a290-7b93884bad1c req-83f05db7-5c88-4c23-8b80-bdb090b963e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044474 May 11 06:50:39.197121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 521/1078] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:50:39.241206 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:39.249183 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5bade26e-26a8-406c-a525-f626e262e6eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.215045 May 11 06:50:39.249755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 558/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:39 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:39.780538 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:39.781152 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:39.787184 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:39.787657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:39.788407 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:39.788839 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:39.920517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:39.927675 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-79bf1d39-28e5-4b23-8a01-cc836ad147d9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.151903 May 11 06:50:39.928235 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 522/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:39 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:40.266113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:40.266723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:40.273052 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:40.273502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:40.274260 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:40.274694 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:40.412798 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:40.420136 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fd5df5d7-8967-46c4-bbb5-b3fb6f1810d2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.157874 May 11 06:50:40.420858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 559/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:40 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:40.947168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:40.947993 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:40.956294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:40.956740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:40.957631 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:40.958067 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.112154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:41.121705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7f790aac-b830-41c8-92c4-977ef3ac1342 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.180530 May 11 06:50:41.124393 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 523/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:40 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:41.437195 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:41.437806 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:41.444240 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.444693 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.445455 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.445891 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.570875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:41.578620 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-599804ca-f7ea-4768-9930-93805a4a45ce tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.145376 May 11 06:50:41.579186 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 560/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:41 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:41.657661 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:41.658154 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:41.664190 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.664631 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.665388 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.665819 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.692192 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:50:41.764175 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ca3960cf-6b08-40cd-8422-a40d141533f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 204 len: 0 microversion: 2.1 time: 0.110667 May 11 06:50:41.764763 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 524/1084] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:50:41 2022] DELETE /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:50:41.772822 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:41.773430 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:41.779829 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.780272 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.781026 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:41.781456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:41.912543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:41.920110 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-38de57f3-014f-4799-8324-14819bb47bde tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1579 microversion: 2.1 time: 0.151277 May 11 06:50:41.920684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 561/1085] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:41 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:42.141572 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:42.142266 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:42.148518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.148968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:42.149733 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.150168 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:42.280019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:42.287244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-90d967ed-6b2b-4064-8dcd-090df1c66426 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.150019 May 11 06:50:42.287842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 525/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:42 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:42.595934 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:42.596549 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:42.602966 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.603452 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:42.604214 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.605137 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:42.734177 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:42.741574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5db7a905-58cc-4beb-94d4-70707941ea32 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.149471 May 11 06:50:42.742146 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 562/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:42 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:42.937470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:42.938039 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:42.952915 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.953369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:42.954140 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:42.954576 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:43.093289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:43.100855 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c20695f3-b1c3-4fee-9a23-3e7b2fee45b6 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1579 microversion: 2.1 time: 0.167245 May 11 06:50:43.101423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 526/1088] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:42 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:43.303890 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:43.304554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:43.310504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:43.310954 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:43.311737 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:43.312173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:43.438982 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:43.446585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8a50fa13-c0cb-4ad1-b948-12144927d500 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.146659 May 11 06:50:43.447157 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 563/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:43 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:43.759325 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:43.759964 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:43.772842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:43.772842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:43.773554 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:43.773969 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.022063 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:44.032379 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1d1fcd9a-9aa3-444c-b86d-183e4589f262 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1507 microversion: 2.1 time: 0.277670 May 11 06:50:44.033008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 527/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:43 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:44.049487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:44.050071 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:44.056082 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.056725 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.057543 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.058361 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.118910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:44.119640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:44.125616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.126178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.127042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.127582 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.175394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b54d836e-e63a-4f8f-a586-152461e8692f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "POST /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46/action" status: 202 len: 0 microversion: 2.1 time: 0.129842 May 11 06:50:44.176286 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 564/1091] 10.222.0.64 () {60 vars in 1277 bytes} [Wed May 11 06:50:44 2022] POST /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:50:44.186097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:44.187002 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:44.193626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.194183 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.195034 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.195573 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.475109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:44.484108 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-40787951-96c7-434e-8ae8-b89edbc49b3f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1579 microversion: 2.1 time: 0.369063 May 11 06:50:44.495631 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 528/1092] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:44 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1579 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:44.500932 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:44.502304 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:44.511396 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.512731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.513861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:44.514541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:44.522267 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:44.539164 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a673f5ab-fe66-473b-a6ca-d464df8158f9 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1515 microversion: 2.1 time: 0.358620 May 11 06:50:44.540417 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 565/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:44 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:44.744419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:44.751860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-34a81711-c8d1-47f8-b183-aca378b086e9 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.254599 May 11 06:50:44.752752 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 529/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:44 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:44.999369 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-b201fecb-5c77-4abe-8538-da6f080b0072 req-3933707f-d433-429e-b9b7-2b98181f64d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2605ddbc-2797-403c-937d-fa10bb1df1b8", "name": "network-vif-deleted", "tag": "49dd66e4-b55f-46a8-b872-9c0eaabb296f"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:45.009238 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b201fecb-5c77-4abe-8538-da6f080b0072 req-3933707f-d433-429e-b9b7-2b98181f64d4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.009706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b201fecb-5c77-4abe-8538-da6f080b0072 req-3933707f-d433-429e-b9b7-2b98181f64d4 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.032442 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-b201fecb-5c77-4abe-8538-da6f080b0072 req-3933707f-d433-429e-b9b7-2b98181f64d4 service nova] Creating event network-vif-deleted:49dd66e4-b55f-46a8-b872-9c0eaabb296f for instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 on hv-cinder-80475 May 11 06:50:45.038400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-b201fecb-5c77-4abe-8538-da6f080b0072 req-3933707f-d433-429e-b9b7-2b98181f64d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043813 May 11 06:50:45.042449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 566/1095] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:45.502076 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:45.502624 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:45.508500 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.508948 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.509744 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.510234 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.540701 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.541159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.541608 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lazy-loading 'fault' on Instance uuid 2605ddbc-2797-403c-937d-fa10bb1df1b8 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:50:45.558254 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:45.559022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:45.565264 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.565982 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.566593 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.567029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.590050 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:45.597652 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0c5e7d8f-de2b-4a05-8f60-17af9555c922 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 200 len: 1230 microversion: 2.1 time: 0.099713 May 11 06:50:45.598453 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 530/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:45 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:45.708134 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:45.716973 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-085de592-7272-4470-918e-063be767635e tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1517 microversion: 2.1 time: 0.163958 May 11 06:50:45.717579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 567/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:45 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:45.769242 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:45.770031 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:45.776998 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.777449 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.778230 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:45.778668 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:45.933038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:45.940853 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-78c635c5-ca16-4e78-b6ba-91c54a9189f7 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.176552 May 11 06:50:45.941426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 531/1098] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:45 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:46.157577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-a11b1cb8-dad7-46fc-a019-f5539701d20a req-8ae21043-60c1-4b21-bde2-a8e906177746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e1463-adc1-4efa-913e-9af96e684d68", "name": "network-vif-plugged", "status": "completed", "tag": "b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:46.165981 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a11b1cb8-dad7-46fc-a019-f5539701d20a req-8ae21043-60c1-4b21-bde2-a8e906177746 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:46.166518 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a11b1cb8-dad7-46fc-a019-f5539701d20a req-8ae21043-60c1-4b21-bde2-a8e906177746 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:46.178847 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-a11b1cb8-dad7-46fc-a019-f5539701d20a req-8ae21043-60c1-4b21-bde2-a8e906177746 service nova] Creating event network-vif-plugged:b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74 for instance e78e1463-adc1-4efa-913e-9af96e684d68 on hv-cinder-80475 May 11 06:50:46.184091 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-a11b1cb8-dad7-46fc-a019-f5539701d20a req-8ae21043-60c1-4b21-bde2-a8e906177746 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101720 May 11 06:50:46.184705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 568/1099] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:46.616208 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:46.616824 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:46.623183 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:46.623662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:46.624428 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:46.624865 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:46.638447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] HTTP exception thrown: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Request method failure captured: May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 HTTP/1.1 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1wXr_jG5rknZEWbqFIDIIQvAEdSPcBNjdoHv804Uo_FjLMBe1LHz9N9lahl2X2CXokr1laNO93ZS-SYllBfGR5XSJxtCocUOYzc6bBNQBWOev-cIQGLsLkr4l-6GtXA5qBctC5Tr6eIaG-ImXXbA6cvo5aZTAbSPhnND936vuKr9SI May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:50:46.640189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-TestVolumeBootPattern-1695130078 May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-TestVolumeBootPattern-1695130078-project May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 94cdac893464447ea8753d29ac7c629b May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-TestVolumeBootPattern-1695130078-project May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:50:46.641910 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '2605ddbc-2797-403c-937d-fa10bb1df1b8'} May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:46.642858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:50:46.644518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:46.645966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Returning 404 to user: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:46.645966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ddcd7e9e-7d33-41a4-b38e-036d4ad8d015 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 404 len: 111 microversion: 2.1 time: 0.029346 May 11 06:50:46.645966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 532/1100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:46 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:46.734808 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:46.735563 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:46.735670 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-376925755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340440310", "security_groups": [{"name": "tempest-secgroup-smoke-2049296380"}], "block_device_mapping_v2": [{"uuid": "a81140c5-4cee-46e3-a3ca-d57f4723d54d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c"}]}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:46.742022 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:46.742546 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:46.743453 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:46.743921 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:46.916456 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] validate_networks() for [('29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:50:47.017247 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:47.027551 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5e99bc35-8237-430f-b542-d3836add1861 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.297070 May 11 06:50:47.028141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 569/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:46 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:47.032876 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:47.033486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:47.039532 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:47.039980 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:47.040736 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:47.041196 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:47.267072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:47.274246 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b78c0c8b-4e82-43a4-a17c-81ccb6e60eeb tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1313 microversion: 2.1 time: 0.245157 May 11 06:50:47.274809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 570/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:47 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:47.524291 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:50:47.524713 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:50:47.525215 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:50:47.525674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:50:47.526567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:50:47.535159 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:47.535630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:47.536427 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:47.536859 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:47.553354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:50:47.557194 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for user 94cdac893464447ea8753d29ac7c629b and project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:50:47.612898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:50:47.614941 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a81140c5-4cee-46e3-a3ca-d57f4723d54d',volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:50:47.737095 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-c3ed03d1-429f-40a8-8c06-64d3b4a0bd7e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.005358 May 11 06:50:47.738066 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 533/1103] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:50:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:50:47.747928 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-338fcfb4-d126-4e22-b5c2-127bdfd3e820 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:47.748580 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-338fcfb4-d126-4e22-b5c2-127bdfd3e820 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:47.808706 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-338fcfb4-d126-4e22-b5c2-127bdfd3e820 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:47.815484 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-338fcfb4-d126-4e22-b5c2-127bdfd3e820 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1094 microversion: 2.1 time: 0.071435 May 11 06:50:47.816144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 571/1104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:47 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:48.045738 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:48.046360 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:48.054014 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.054458 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.055357 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.055789 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.291473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:48.292238 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:48.299454 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.299905 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.300684 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.301149 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.517584 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:48.522986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:48.526721 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-365c036f-c7ca-4e13-9aad-73b9c3d5a593 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.485993 May 11 06:50:48.527394 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 534/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:48 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:48.531791 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-45599194-09ff-4753-9657-69d59bfb5c53 req-fe3fc9d7-b182-4f7c-b524-a27649aad039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "name": "network-vif-unplugged", "status": "completed", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:48.537135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-47d48070-b1f2-4005-a549-4230114357c1 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1497 microversion: 2.1 time: 0.249453 May 11 06:50:48.537916 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 572/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:48 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:48.540518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-45599194-09ff-4753-9657-69d59bfb5c53 req-fe3fc9d7-b182-4f7c-b524-a27649aad039 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.540674 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-45599194-09ff-4753-9657-69d59bfb5c53 req-fe3fc9d7-b182-4f7c-b524-a27649aad039 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.558892 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-45599194-09ff-4753-9657-69d59bfb5c53 req-fe3fc9d7-b182-4f7c-b524-a27649aad039 service nova] Creating event network-vif-unplugged:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:50:48.563854 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-45599194-09ff-4753-9657-69d59bfb5c53 req-fe3fc9d7-b182-4f7c-b524-a27649aad039 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035292 May 11 06:50:48.564510 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 535/1107] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:48.832997 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:48.833618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:48.839983 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.840436 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.841208 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:48.841652 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:48.907392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:48.914976 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0b38fae-3967-4d4d-8207-e89d5ad04e5b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1192 microversion: 2.1 time: 0.085664 May 11 06:50:48.915586 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 573/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:48 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:49.016658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:49.017239 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:49.023420 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.023868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.024637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.025072 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.052457 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:50:49.138030 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d6e8cf21-ad84-4bfb-bed8-eba3788e273e tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 204 len: 0 microversion: 2.1 time: 0.125770 May 11 06:50:49.138630 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 536/1109] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:50:49 2022] DELETE /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:50:49.148927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:49.150802 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:49.157899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.158658 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.159748 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.160632 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.292517 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:49.299884 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e265bae3-3fa9-45ad-9c74-e79afc82f18f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1503 microversion: 2.1 time: 0.156773 May 11 06:50:49.300449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 574/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:49 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:49.544614 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:49.545244 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:49.551347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.551797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.552589 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.553021 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.691459 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:49.699354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-21bbea8c-d30b-4616-adf7-e16c60a5d421 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.159026 May 11 06:50:49.699914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 537/1111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:49 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:49.933076 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:49.933648 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:49.940080 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.940524 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:49.941278 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:49.941708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:50.003142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:50.012392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bee180fd-077f-4eae-9ee1-b5b5e03eaf05 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1210 microversion: 2.1 time: 0.083704 May 11 06:50:50.013221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 575/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:49 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:50.316799 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:50.318041 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:50.324765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:50.325375 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:50.327770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:50.327770 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:50.508937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:50.516373 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-acd21fe7-0035-4a18-be3b-f90403656b56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1503 microversion: 2.1 time: 0.203394 May 11 06:50:50.517055 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 538/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:50 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:50.716817 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:50.717433 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:50.723688 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:50.724510 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:50.725296 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:50.725731 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:50.973181 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:50.983695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-922d027e-cfa3-4e95-ae33-af2d8565aace tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.271011 May 11 06:50:50.995901 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 576/1114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:50 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:51.034693 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:51.035427 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:51.042219 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.042761 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.043640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.044160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.268642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:51.276694 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-16f196cc-7aab-46a2-b2c5-fdd1689cf33f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.246272 May 11 06:50:51.277399 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 539/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:51 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:51.527209 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-d364b6cd-dfe7-4912-8ada-0d523ff03e72 req-3be82627-39be-482a-a066-1d7dbc2913c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e1463-adc1-4efa-913e-9af96e684d68", "name": "network-vif-deleted", "tag": "b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:51.533488 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:51.534842 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:51.542292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.543079 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.544121 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.544946 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.546046 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d364b6cd-dfe7-4912-8ada-0d523ff03e72 req-3be82627-39be-482a-a066-1d7dbc2913c9 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.546471 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-d364b6cd-dfe7-4912-8ada-0d523ff03e72 req-3be82627-39be-482a-a066-1d7dbc2913c9 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.566093 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-d364b6cd-dfe7-4912-8ada-0d523ff03e72 req-3be82627-39be-482a-a066-1d7dbc2913c9 service nova] Creating event network-vif-deleted:b0fb1d0a-6f9c-4e9f-92a8-3cb3e2183d74 for instance e78e1463-adc1-4efa-913e-9af96e684d68 on hv-cinder-80475 May 11 06:50:51.572554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-d364b6cd-dfe7-4912-8ada-0d523ff03e72 req-3be82627-39be-482a-a066-1d7dbc2913c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107895 May 11 06:50:51.574405 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 577/1116] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:51.596966 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.597421 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.597897 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.objects.instance [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lazy-loading 'fault' on Instance uuid e78e1463-adc1-4efa-913e-9af96e684d68 {{(pid=128923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:50:51.674164 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:51.681628 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1a47e908-1270-465a-9666-183352722dd2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 200 len: 1303 microversion: 2.1 time: 0.151795 May 11 06:50:51.682203 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 540/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:51 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:51.827496 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-2ade1a64-2f87-49e0-9b04-c948c197b31d req-8f3c5d8e-3ffe-4ea1-bb56-28f94ba0a116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099e2318-b1a5-41e1-b650-788036a4e19a", "tag": "63deefb4-c65e-4800-9773-117330932a29"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:51.857585 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2ade1a64-2f87-49e0-9b04-c948c197b31d req-8f3c5d8e-3ffe-4ea1-bb56-28f94ba0a116 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:51.858036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2ade1a64-2f87-49e0-9b04-c948c197b31d req-8f3c5d8e-3ffe-4ea1-bb56-28f94ba0a116 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:51.870992 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-2ade1a64-2f87-49e0-9b04-c948c197b31d req-8f3c5d8e-3ffe-4ea1-bb56-28f94ba0a116 service nova] Creating event network-changed:63deefb4-c65e-4800-9773-117330932a29 for instance 099e2318-b1a5-41e1-b650-788036a4e19a on hv-cinder-80475 May 11 06:50:51.876487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-2ade1a64-2f87-49e0-9b04-c948c197b31d req-8f3c5d8e-3ffe-4ea1-bb56-28f94ba0a116 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053794 May 11 06:50:51.877221 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 578/1118] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:52.001196 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:52.002626 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:52.009032 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.009479 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.010274 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.010987 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.204623 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:52.212109 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5076c6a3-a263-4961-a906-f763ad1abae7 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.214838 May 11 06:50:52.212672 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 541/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:51 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:52.295497 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:52.296223 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:52.302169 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.302618 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.303437 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.303875 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.465265 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:52.472624 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-30366eba-6b56-4b57-a7fb-40f6020f85ca tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.182466 May 11 06:50:52.473200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 579/1120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:52 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:52.700029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:52.700641 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: e78e1463-adc1-4efa-913e-9af96e684d68] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:52.711405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.711405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.711405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:52.711405 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:52.722742 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] HTTP exception thrown: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Request method failure captured: May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 HTTP/1.1 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1y5PbAyjERdiY5CpxhHctDpURjVcF4DBlPwjiIaxac60bGOAdjJqTueyAh3lhDboiTE22qjVb3Iv_AcagB8EMQI3eMXSM1s9K85CjfFU3NzmtuNlvwXR3Ql1-fUpfeZ9EnN_zg0-YH_luaqPgme8SrBeziL4ykeayxO9dSpEPuWZSI May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 3ce3abdf08024c23b5dbe4d353057d94 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-VolumesActionsTest-615932833 May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:50:52.724429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-VolumesActionsTest-615932833 May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 3ce3abdf08024c23b5dbe4d353057d94 May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-VolumesActionsTest-615932833 May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-VolumesActionsTest-615932833-project May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 99d0cd8a42c9463ba9dd90f9fcc10d36 May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-VolumesActionsTest-615932833-project May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. May 11 06:50:52.730044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': 'e78e1463-adc1-4efa-913e-9af96e684d68'} May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:50:52.732094 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. May 11 06:50:52.733829 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:50:52.735371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Returning 404 to user: Instance e78e1463-adc1-4efa-913e-9af96e684d68 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:50:52.735371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-18c0eacb-1aa9-48d0-ac8e-9e1240feaa10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68" status: 404 len: 111 microversion: 2.1 time: 0.030420 May 11 06:50:52.735371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 542/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:52 2022] GET /compute/v2.1/servers/e78e1463-adc1-4efa-913e-9af96e684d68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:50:52.772595 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-227410382", "imageRef": "cea30267-d9ea-484e-9d36-9d64218e7405", "flavorRef": "452", "networks": [{"uuid": "c7951eaf-d227-4a93-9663-83075f8dba8d"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:52.821311 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] validate_networks() for [('c7951eaf-d227-4a93-9663-83075f8dba8d', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:50:53.230051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:53.230570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:53.236403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.236851 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.237610 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.238042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.446445 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:50:53.446961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:50:53.447377 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:50:53.447809 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:50:53.448841 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:50:53.458231 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.458670 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.459487 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.459918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.460458 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:53.467720 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-40564d29-a1fd-4362-8d78-ebc1f9c8fd5d tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.242115 May 11 06:50:53.468280 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 543/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:53 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:53.476033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Getting quotas for project 3ce3abdf08024c23b5dbe4d353057d94. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:50:53.479938 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Getting quotas for user 99d0cd8a42c9463ba9dd90f9fcc10d36 and project 3ce3abdf08024c23b5dbe4d353057d94. Resources: {'ram', 'cores', 'instances'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:50:53.489272 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:53.489885 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:53.490621 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:50:53.492882 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cea30267-d9ea-484e-9d36-9d64218e7405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:50:53.496800 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.497423 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.498218 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:53.498657 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:53.539681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-383f1afe-b59e-4bae-a91e-1d89c5683f35 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770846 May 11 06:50:53.540315 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 580/1123] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:50:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:50:53.550212 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-279070f2-7e66-49eb-86a9-d6157c5d0b96 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:53.550923 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-279070f2-7e66-49eb-86a9-d6157c5d0b96 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:53.625025 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-279070f2-7e66-49eb-86a9-d6157c5d0b96 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:53.631638 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-279070f2-7e66-49eb-86a9-d6157c5d0b96 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1213 microversion: 2.1 time: 0.085237 May 11 06:50:53.633726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 581/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:53 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:53.666570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:53.674191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f2d7c9c6-48b7-4b64-bc50-3fe16c72b97f tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.188551 May 11 06:50:53.674834 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 544/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:53 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:54.485527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:54.486138 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:54.493102 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.493557 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.494321 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.494757 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.624416 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:54.632429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa553efb-c6ae-4731-8387-a4eddc474faa tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.150738 May 11 06:50:54.633284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 582/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:54 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:54.649314 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:54.650009 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:54.659006 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.659489 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.660265 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.660703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.691626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:54.692180 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:54.698799 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.699249 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.700048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:54.700483 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:54.768590 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:54.777163 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-799ef8d0-d695-49f0-9748-10bd8512b0c6 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1273 microversion: 2.1 time: 0.131179 May 11 06:50:54.777766 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 545/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:54 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:54.866559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:54.873961 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-12d2ccff-0ac8-41f5-bf1d-cd5e3465f1ba tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.186202 May 11 06:50:54.874530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 583/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:54 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:55.650485 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:55.652491 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:55.659619 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.660065 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:55.661161 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.661637 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:55.794429 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:55.795048 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:55.801370 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.801824 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:55.802594 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.803037 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:55.914039 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:55.923755 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5587a4bd-49a5-47e9-993b-4bf1a4bb1050 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.277208 May 11 06:50:55.924334 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 546/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:55 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:55.938553 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:55.939171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:55.946592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.947053 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:55.948011 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:55.948640 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:56.080343 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:56.089135 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3e6e313b-a18a-46e5-aa72-57acdba899f2 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.298414 May 11 06:50:56.089816 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 584/1130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:55 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:56.208125 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:56.215869 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5aaecad2-801c-4c47-9488-629e00e11c04 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.281090 May 11 06:50:56.216435 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 547/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:55 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:56.353713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-138ba195-221c-4a5c-ad74-bf47977ea18d req-4a0a345f-06b8-4b9d-8a73-f88ef66bc37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86724d6e-8b72-4b57-9cc6-6ecdbf527aa4", "tag": "ee7931e1-c638-40ab-81de-06f191a82fc7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:56.363177 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-138ba195-221c-4a5c-ad74-bf47977ea18d req-4a0a345f-06b8-4b9d-8a73-f88ef66bc37b service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:56.364379 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-138ba195-221c-4a5c-ad74-bf47977ea18d req-4a0a345f-06b8-4b9d-8a73-f88ef66bc37b service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:56.375713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-138ba195-221c-4a5c-ad74-bf47977ea18d req-4a0a345f-06b8-4b9d-8a73-f88ef66bc37b service nova] Creating event network-changed:ee7931e1-c638-40ab-81de-06f191a82fc7 for instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 on hv-cinder-80475 May 11 06:50:56.380753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-138ba195-221c-4a5c-ad74-bf47977ea18d req-4a0a345f-06b8-4b9d-8a73-f88ef66bc37b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030941 May 11 06:50:56.381411 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 585/1132] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:56.940176 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:56.940801 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:56.947087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:56.947575 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:56.949155 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:56.949726 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:57.108115 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:57.109032 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:57.115143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:57.115623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:57.116392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:57.116838 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:57.117130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:57.125282 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-7bfc106c-7234-45e2-b80e-c8d92c7f89c5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.189014 May 11 06:50:57.125858 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 548/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:56 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:57.233593 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:57.234228 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:57.240048 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:57.240495 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:57.241258 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:57.241697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:57.245690 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:57.253096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4db44d02-03f7-4ce2-bd1d-f3d2c80de51a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.150842 May 11 06:50:57.253705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 586/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:57 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:57.371225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:57.378504 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a3fc9d46-57f7-4c1b-b90d-b22c70e15914 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.149676 May 11 06:50:57.379075 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 549/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:57 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:58.051029 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-5a7132f0-ecb3-43b9-802b-152a56056b18 req-2cdd11fe-f3de-445a-977f-5c110661860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "name": "network-vif-plugged", "status": "completed", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:50:58.059768 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5a7132f0-ecb3-43b9-802b-152a56056b18 req-2cdd11fe-f3de-445a-977f-5c110661860b service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.060229 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5a7132f0-ecb3-43b9-802b-152a56056b18 req-2cdd11fe-f3de-445a-977f-5c110661860b service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.071113 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-5a7132f0-ecb3-43b9-802b-152a56056b18 req-2cdd11fe-f3de-445a-977f-5c110661860b service nova] Creating event network-vif-plugged:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:50:58.076665 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-5a7132f0-ecb3-43b9-802b-152a56056b18 req-2cdd11fe-f3de-445a-977f-5c110661860b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 May 11 06:50:58.077248 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 587/1136] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:50:58.142385 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:58.142990 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:58.149278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.149722 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.150501 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.150929 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.270811 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:58.271539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:58.277673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.278119 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.278891 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.279355 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.279937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:58.287171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1309d2cc-8b51-4caa-868e-fe4fc99df0eb tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.148605 May 11 06:50:58.288042 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 550/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:58 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:58.395339 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:58.396080 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:58.401996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.402433 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.403216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:58.403676 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:58.411578 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:58.419185 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f0e4cfb4-f2e4-4d57-98a5-a65e4c3ec4a3 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.153009 May 11 06:50:58.419812 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 588/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:58 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:58.549846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:58.558743 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-75e8eb60-04dd-4ab3-ba0b-474ddd7b1b7b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.167246 May 11 06:50:58.559369 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 551/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:58 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:59.304989 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:59.305623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:59.312021 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.312475 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.313234 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.313671 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.436806 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:59.437426 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:59.443739 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:59.444001 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.444269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.445044 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.445476 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.452666 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b9e5e873-d688-454c-b302-90157930348c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1573 microversion: 2.1 time: 0.151517 May 11 06:50:59.453347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 589/1140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:59 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:50:59.574547 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:59.576475 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:50:59.577347 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:50:59.582134 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ed0eea98-bbcc-4ad8-847e-47f8f9dfb2d8 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.149900 May 11 06:50:59.582700 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 552/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:59 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:50:59.583055 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.583534 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.584300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:50:59.584726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:50:59.714039 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:50:59.721317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d0585701-ddb0-4330-8cc7-5b3c20ed9723 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.149453 May 11 06:50:59.722013 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 590/1142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:50:59 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:00.470238 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:00.470958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:00.477189 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.477642 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.478410 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.478848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.597996 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:00.598611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:00.605300 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.605753 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.606538 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.606977 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.612093 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:00.619648 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-387d50cc-c907-4f36-8a96-a9017a11abb5 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1560 microversion: 2.1 time: 0.153228 May 11 06:51:00.620206 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 553/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:00 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:00.737797 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:00.738416 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:00.738527 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:00.744404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.744848 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.745617 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:00.745897 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3205df54-297d-4697-ba6f-211921369a1a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.151835 May 11 06:51:00.746052 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:00.746473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 591/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:00 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:00.871534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:00.878697 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1ba84c60-6892-4850-8ac5-04e56138b1a3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.144723 May 11 06:51:00.879284 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 554/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:00 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:01.762626 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:01.763171 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:01.769565 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:01.770019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:01.770785 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:01.771224 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:01.896059 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:01.896586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:01.898365 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:01.903861 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:01.904313 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:01.905082 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:01.905518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:01.906309 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-285cd6ec-59a6-4ac5-b5e4-3ed47fae6e56 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.147646 May 11 06:51:01.907201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 592/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:01 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:02.036408 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:02.044341 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-d67a263d-9396-4579-9c81-0ea376ca98da tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.152201 May 11 06:51:02.044914 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 555/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:01 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:02.224540 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-fe81a43b-3906-4989-bc17-45c6df437901 req-52aa8861-f644-4216-88ef-22dfa3a7cc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86724d6e-8b72-4b57-9cc6-6ecdbf527aa4", "name": "network-vif-plugged", "status": "completed", "tag": "ee7931e1-c638-40ab-81de-06f191a82fc7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:51:02.232466 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-fe81a43b-3906-4989-bc17-45c6df437901 req-52aa8861-f644-4216-88ef-22dfa3a7cc12 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:02.233036 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-fe81a43b-3906-4989-bc17-45c6df437901 req-52aa8861-f644-4216-88ef-22dfa3a7cc12 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:02.243946 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-fe81a43b-3906-4989-bc17-45c6df437901 req-52aa8861-f644-4216-88ef-22dfa3a7cc12 service nova] Creating event network-vif-plugged:ee7931e1-c638-40ab-81de-06f191a82fc7 for instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 on hv-cinder-80475 May 11 06:51:02.248635 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-fe81a43b-3906-4989-bc17-45c6df437901 req-52aa8861-f644-4216-88ef-22dfa3a7cc12 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027930 May 11 06:51:02.249228 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 593/1148] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:51:02.923417 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:02.924033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:02.930492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:02.930934 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:02.931765 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:02.932867 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:03.062636 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:03.062991 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:03.063728 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:03.069700 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:03.070000 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-3d8a9d81-7c71-41cf-9e35-0d49f689621c tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1313 microversion: 2.1 time: 0.150469 May 11 06:51:03.070160 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:03.070566 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 556/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:02 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:03.071015 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:03.071552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:03.198550 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:03.206104 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-310fbf45-8ca0-464a-b0d5-c8b7f0a63137 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.147815 May 11 06:51:03.206677 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 594/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:03 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:04.085780 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:04.086392 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:04.092782 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.093225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.093989 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.094419 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.223602 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:04.224334 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:04.225999 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:04.230649 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.231128 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.231926 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.232363 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.233400 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-f992f2cf-b9ed-4140-a568-1b7a7c9bf85f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1497 microversion: 2.1 time: 0.151428 May 11 06:51:04.233965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 557/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:04 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:04.277007 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-14a6477e-aab1-4e13-a3e5-454768ea5392 req-ee5490bf-24a1-48cc-a525-56bb38808642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099e2318-b1a5-41e1-b650-788036a4e19a", "name": "network-vif-plugged", "status": "completed", "tag": "63deefb4-c65e-4800-9773-117330932a29"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:51:04.285215 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-14a6477e-aab1-4e13-a3e5-454768ea5392 req-ee5490bf-24a1-48cc-a525-56bb38808642 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.285664 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-14a6477e-aab1-4e13-a3e5-454768ea5392 req-ee5490bf-24a1-48cc-a525-56bb38808642 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.297160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-14a6477e-aab1-4e13-a3e5-454768ea5392 req-ee5490bf-24a1-48cc-a525-56bb38808642 service nova] Creating event network-vif-plugged:63deefb4-c65e-4800-9773-117330932a29 for instance 099e2318-b1a5-41e1-b650-788036a4e19a on hv-cinder-80475 May 11 06:51:04.302054 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-14a6477e-aab1-4e13-a3e5-454768ea5392 req-ee5490bf-24a1-48cc-a525-56bb38808642 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029370 May 11 06:51:04.302958 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 558/1152] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:51:04.368162 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:04.376807 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3fca445b-56af-4264-97e9-4c50c77f2a27 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.157053 May 11 06:51:04.377401 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 595/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:04 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:04.765363 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:04.765951 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:04.772051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.772503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.773273 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.773716 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.798766 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:51:04.868365 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-71fffcb8-c638-4595-9105-a8009a310a1f tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 204 len: 0 microversion: 2.1 time: 0.106933 May 11 06:51:04.868935 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 559/1154] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:51:04 2022] DELETE /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:51:04.877176 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:04.877790 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:04.884384 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.884832 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:04.885587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:04.886027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:05.017504 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:05.024751 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e6a62ccd-1793-4702-b86b-dc61787ec15a tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1503 microversion: 2.1 time: 0.151451 May 11 06:51:05.025314 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 596/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:04 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:05.453561 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:05.454298 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:05.460594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:05.461051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:05.461813 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:05.462278 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:05.588367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:05.595658 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0c5fadec-2e51-46b5-8ecc-e0de75c785b0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.146547 May 11 06:51:05.596224 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 560/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:05 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:06.043440 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:06.044054 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:06.050332 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:06.050789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:06.051587 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:06.052027 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:06.180623 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:06.187970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-53b2ec72-c76e-40d3-a790-7e30c4e1ae10 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1503 microversion: 2.1 time: 0.148983 May 11 06:51:06.188558 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 597/1157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:06 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:06.612374 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:06.612987 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:06.619287 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:06.619777 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:06.620543 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:06.620978 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:06.748183 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:06.755465 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-96392a51-abe0-4968-b214-538a80936e0e tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1266 microversion: 2.1 time: 0.146904 May 11 06:51:06.756028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 561/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:06 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:07.205182 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:07.205781 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:07.212488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.212927 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.213695 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.214126 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.447213 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d0cd8a42c9463ba9dd90f9fcc10d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce3abdf08024c23b5dbe4d353057d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:07.455047 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3acf27f5-94e9-45f9-976a-dde2e8d33693 tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 200 len: 1503 microversion: 2.1 time: 0.253948 May 11 06:51:07.455723 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 598/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:07 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:51:07.712906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-3bbd2de9-f3de-4982-bc56-e4842ede4ec3 req-40982448-0d42-4b5a-b143-c06e9b6c228e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86724d6e-8b72-4b57-9cc6-6ecdbf527aa4", "name": "network-vif-deleted", "tag": "ee7931e1-c638-40ab-81de-06f191a82fc7"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:51:07.723480 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-3bbd2de9-f3de-4982-bc56-e4842ede4ec3 req-40982448-0d42-4b5a-b143-c06e9b6c228e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.724289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-3bbd2de9-f3de-4982-bc56-e4842ede4ec3 req-40982448-0d42-4b5a-b143-c06e9b6c228e service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.740904 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-3bbd2de9-f3de-4982-bc56-e4842ede4ec3 req-40982448-0d42-4b5a-b143-c06e9b6c228e service nova] Creating event network-vif-deleted:ee7931e1-c638-40ab-81de-06f191a82fc7 for instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 on hv-cinder-80475 May 11 06:51:07.747058 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-3bbd2de9-f3de-4982-bc56-e4842ede4ec3 req-40982448-0d42-4b5a-b143-c06e9b6c228e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037814 May 11 06:51:07.747688 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 562/1160] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:51:07.772903 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:07.773519 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:07.779835 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.780292 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.781032 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.781463 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.913681 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:07.921705 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-61514c1b-315c-4353-b38d-e7523c355210 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1454 microversion: 2.1 time: 0.152881 May 11 06:51:07.922284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 599/1161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:07 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:07.938358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:07.939051 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:07.945136 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.945587 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:07.946349 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:07.946784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:08.076568 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:51:08.083846 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5499435e-bd5e-476b-95fa-126dd9cc2359 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1454 microversion: 2.1 time: 0.149565 May 11 06:51:08.084407 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 563/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:07 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:51:08.471604 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:51:08.472367 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] [instance: 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:51:08.478530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:08.478968 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:08.479749 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:08.480175 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:08.493400 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] HTTP exception thrown: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Request method failure captured: May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 HTTP/1.1 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1y5PbAyjERdiY5CpxhHctDpURjVcF4DBlPwjiIaxac60bGOAdjJqTueyAh3lhDboiTE22qjVb3Iv_AcagB8EMQI3eMXSM1s9K85CjfFU3NzmtuNlvwXR3Ql1-fUpfeZ9EnN_zg0-YH_luaqPgme8SrBeziL4ykeayxO9dSpEPuWZSI May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 3ce3abdf08024c23b5dbe4d353057d94 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesActionsTest-615932833 May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:51:08.495554 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3ce3abdf08024c23b5dbe4d353057d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesActionsTest-615932833 May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 3ce3abdf08024c23b5dbe4d353057d94 May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesActionsTest-615932833 May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesActionsTest-615932833-project May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 99d0cd8a42c9463ba9dd90f9fcc10d36 May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesActionsTest-615932833-project May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. May 11 06:51:08.497336 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '86724d6e-8b72-4b57-9cc6-6ecdbf527aa4'} May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:51:08.503530 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. May 11 06:51:08.505742 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:51:08.507097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] Returning 404 to user: Instance 86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:51:08.507097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0b5d995b-6ee1-41d5-a833-dfbd23c97bcf tempest-VolumesActionsTest-615932833 tempest-VolumesActionsTest-615932833-project] 10.222.0.64 "GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4" status: 404 len: 111 microversion: 2.1 time: 0.029316 May 11 06:51:08.507097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 600/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:51:08 2022] GET /compute/v2.1/servers/86724d6e-8b72-4b57-9cc6-6ecdbf527aa4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:51:09.800560 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-9a038156-6a3a-4f48-ad78-3f34807b8788 req-cfb70823-7fff-4cb4-87b6-c1a31d90b3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099e2318-b1a5-41e1-b650-788036a4e19a", "tag": "63deefb4-c65e-4800-9773-117330932a29"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:51:09.809517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-9a038156-6a3a-4f48-ad78-3f34807b8788 req-cfb70823-7fff-4cb4-87b6-c1a31d90b3fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:51:09.810028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-9a038156-6a3a-4f48-ad78-3f34807b8788 req-cfb70823-7fff-4cb4-87b6-c1a31d90b3fd service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:51:09.820987 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-9a038156-6a3a-4f48-ad78-3f34807b8788 req-cfb70823-7fff-4cb4-87b6-c1a31d90b3fd service nova] Creating event network-changed:63deefb4-c65e-4800-9773-117330932a29 for instance 099e2318-b1a5-41e1-b650-788036a4e19a on hv-cinder-80475 May 11 06:51:09.826260 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-9a038156-6a3a-4f48-ad78-3f34807b8788 req-cfb70823-7fff-4cb4-87b6-c1a31d90b3fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029379 May 11 06:51:09.827193 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 564/1164] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:52:25.794913 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:25.795473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:52:25.801929 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:25.802376 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:25.803139 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:25.803633 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:25.805371 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-53983168-7a0b-4660-9b78-5332c7996b28 req-5e227e0b-127a-47c4-8831-beff52f0a8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:52:25.814600 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-53983168-7a0b-4660-9b78-5332c7996b28 req-5e227e0b-127a-47c4-8831-beff52f0a8ba service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:25.815033 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-53983168-7a0b-4660-9b78-5332c7996b28 req-5e227e0b-127a-47c4-8831-beff52f0a8ba service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:25.828774 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-53983168-7a0b-4660-9b78-5332c7996b28 req-5e227e0b-127a-47c4-8831-beff52f0a8ba service nova] Creating event network-changed:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:52:25.829713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:52:25.835087 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-53983168-7a0b-4660-9b78-5332c7996b28 req-5e227e0b-127a-47c4-8831-beff52f0a8ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035376 May 11 06:52:25.837016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 565/1165] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:52:25.922435 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9508b24a-31b3-478d-94cf-8386115dfdf2 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "DELETE /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 204 len: 0 microversion: 2.1 time: 0.131671 May 11 06:52:25.926397 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 601/1166] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:52:25 2022] DELETE /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:52:25.932994 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:25.933677 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:52:25.940008 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:25.940454 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:25.941216 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:25.941645 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:26.075616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:52:26.083398 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ca6506e3-ebe5-408f-a784-69a559ca6e4c tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.155594 May 11 06:52:26.083965 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 566/1167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:52:25 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:52:27.102258 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:27.102955 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:52:27.109364 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:27.109810 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:27.110577 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:27.111014 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:27.316708 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:52:27.324672 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-65103f0e-367d-4fe9-a0c8-1e822e99f422 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1566 microversion: 2.1 time: 0.226642 May 11 06:52:27.325230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 602/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:52:27 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:52:28.274161 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-80192d41-b29a-4e9f-a050-5e01612e1056 req-6f6789f2-feb8-44d9-8b75-3a34c845b271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876c9add-17b5-422d-8b96-30da512c6d46", "name": "network-vif-deleted", "tag": "73125ec0-d189-4f79-ab95-8143efd026c7"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:52:28.283845 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-80192d41-b29a-4e9f-a050-5e01612e1056 req-6f6789f2-feb8-44d9-8b75-3a34c845b271 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:28.284412 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-80192d41-b29a-4e9f-a050-5e01612e1056 req-6f6789f2-feb8-44d9-8b75-3a34c845b271 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:28.295961 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-80192d41-b29a-4e9f-a050-5e01612e1056 req-6f6789f2-feb8-44d9-8b75-3a34c845b271 service nova] Creating event network-vif-deleted:73125ec0-d189-4f79-ab95-8143efd026c7 for instance 876c9add-17b5-422d-8b96-30da512c6d46 on hv-cinder-80475 May 11 06:52:28.300635 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-80192d41-b29a-4e9f-a050-5e01612e1056 req-6f6789f2-feb8-44d9-8b75-3a34c845b271 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 May 11 06:52:28.301238 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 567/1169] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:52:28.342225 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:28.342899 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:52:28.349638 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:28.350081 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:28.350833 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:28.351308 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:28.417685 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0b99029c246448da0a2d0e26a16f43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6758effb73344c895a7ed675378f8df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:52:28.425143 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dcf042f2-6d69-49dc-ac34-bc3cf4b35d52 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 200 len: 1219 microversion: 2.1 time: 0.086730 May 11 06:52:28.425720 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 603/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:52:28 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:52:29.443251 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:29.444010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [instance: 876c9add-17b5-422d-8b96-30da512c6d46] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:52:29.450749 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:29.451198 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:29.452010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:52:29.452705 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:52:29.465494 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] HTTP exception thrown: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Request method failure captured: May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 HTTP/1.1 May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1wMB79pmY55G_CaYHudL1CMyInCILzdKaa5tGtbffCdaNIiaAwUXVa8SBJElMScW1HpQva4WjhE1gzRV-6kTCCx_lT5lJS6xSbypLZRcDp2NiZFZJjLJpQ5dLSQfzEvvev08zuNIEdztqIj7ufyUnM3Hkc5sGop36wtY2sgkF000Gc May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: e6758effb73344c895a7ed675378f8df May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-TestShelveInstance-1806653597 May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:52:29.467078 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e6758effb73344c895a7ed675378f8df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e6758effb73344c895a7ed675378f8df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e6758effb73344c895a7ed675378f8df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e6758effb73344c895a7ed675378f8df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-TestShelveInstance-1806653597 May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: e6758effb73344c895a7ed675378f8df May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-TestShelveInstance-1806653597 May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-TestShelveInstance-1806653597-project May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: f0b99029c246448da0a2d0e26a16f43d May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-TestShelveInstance-1806653597-project May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. May 11 06:52:29.468784 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '876c9add-17b5-422d-8b96-30da512c6d46'} May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:52:29.469681 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. May 11 06:52:29.471046 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:52:29.472281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Returning 404 to user: Instance 876c9add-17b5-422d-8b96-30da512c6d46 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:52:29.472281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4c0b7698-0656-44f5-98a8-c43753167e10 tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46" status: 404 len: 111 microversion: 2.1 time: 0.029862 May 11 06:52:29.472281 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 568/1171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:52:29 2022] GET /compute/v2.1/servers/876c9add-17b5-422d-8b96-30da512c6d46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:52:29.622141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5b2b6142-7db5-498a-8cd7-c65cabeccb9f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] Calling method '.version_select at 0x7fc5c8a33940>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:52:29.625502 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b2b6142-7db5-498a-8cd7-c65cabeccb9f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [eb5a1eff-dca8-4246-a0f8-f79a04551636] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 11 06:52:30.633109 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b2b6142-7db5-498a-8cd7-c65cabeccb9f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] [eb5a1eff-dca8-4246-a0f8-f79a04551636] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 50286. May 11 06:52:30.652019 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5b2b6142-7db5-498a-8cd7-c65cabeccb9f tempest-TestShelveInstance-1806653597 tempest-TestShelveInstance-1806653597-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-438922881" status: 202 len: 0 microversion: 2.1 time: 1.034225 May 11 06:52:30.652600 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 604/1172] 10.222.0.64 () {58 vars in 1250 bytes} [Wed May 11 06:52:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-438922881 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:53:06.961358 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2114147050", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340440310", "security_groups": [{"name": "tempest-secgroup-smoke-2049296380"}], "block_device_mapping_v2": [{"uuid": "b57c044d-7b2c-4e5a-ba99-d9c1467cba58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c"}]}} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:53:07.069290 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.network.neutron [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] validate_networks() for [('29671e96-b0fa-4eaa-b6c4-d6d9baf9fb5c', None, None, None, None, None)] {{(pid=128923) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:53:07.440786 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:53:07.441275 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image limits 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:53:07.441760 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Flavor pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:53:07.442199 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Image pref 0:0:0 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:53:07.442610 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.virt.hardware [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:53:07.451772 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:07.452224 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:07.453289 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:07.453731 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:07.470377 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:53:07.474342 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.quota [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Getting quotas for user 94cdac893464447ea8753d29ac7c629b and project 549cd5f2cff143c69dd1e4568d7bd3e6. Resources: {'ram', 'cores', 'instances'} {{(pid=128923) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:53:07.530062 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Going to run 1 instances... {{(pid=128923) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:53:07.532160 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b57c044d-7b2c-4e5a-ba99-d9c1467cba58',volume_size=None,volume_type=None)] {{(pid=128923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:53:07.652898 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-044b73d9-9a4d-41ed-b25a-988b9ad355f3 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695319 May 11 06:53:07.653535 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 569/1173] 10.222.0.64 () {60 vars in 1146 bytes} [Wed May 11 06:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:53:07.663911 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4c5a6496-46cc-4563-a716-386999c63ca0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:07.664652 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4c5a6496-46cc-4563-a716-386999c63ca0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:07.718144 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4c5a6496-46cc-4563-a716-386999c63ca0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:07.724713 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4c5a6496-46cc-4563-a716-386999c63ca0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1095 microversion: 2.1 time: 0.065089 May 11 06:53:07.725276 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 605/1174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:07 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:08.742103 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:08.742754 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:08.749664 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:08.750112 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:08.750877 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:08.751333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:08.820403 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:08.828594 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-ba48e3e2-7570-43ed-b07d-cc454d19b26b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1211 microversion: 2.1 time: 0.090843 May 11 06:53:08.829429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 570/1175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:08 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:09.846283 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:09.847021 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:09.853846 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:09.854295 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:09.855064 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:09.855531 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:09.999099 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:10.006918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2a645b80-81ba-4012-afe8-66b3ecd4aeb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.164870 May 11 06:53:10.007520 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 606/1176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:09 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:10.077616 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-45191c1a-15a8-4739-ba2b-e42b6e42cfad req-70f24de3-d6ad-47aa-9c28-20e0738bb67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f55e67e-91fb-44d2-b518-109bd956ad67", "tag": "99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:53:10.089601 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-45191c1a-15a8-4739-ba2b-e42b6e42cfad req-70f24de3-d6ad-47aa-9c28-20e0738bb67d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:10.090534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-45191c1a-15a8-4739-ba2b-e42b6e42cfad req-70f24de3-d6ad-47aa-9c28-20e0738bb67d service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:10.104977 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-45191c1a-15a8-4739-ba2b-e42b6e42cfad req-70f24de3-d6ad-47aa-9c28-20e0738bb67d service nova] Creating event network-changed:99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf for instance 6f55e67e-91fb-44d2-b518-109bd956ad67 on hv-cinder-80475 May 11 06:53:10.110225 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-45191c1a-15a8-4739-ba2b-e42b6e42cfad req-70f24de3-d6ad-47aa-9c28-20e0738bb67d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036569 May 11 06:53:10.111429 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 571/1177] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:53:11.024200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:11.024819 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:11.032559 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:11.033072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:11.034358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:11.034358 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:11.167930 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:11.175129 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-02f673e9-1348-4ffb-9ef4-563d82af455c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.154808 May 11 06:53:11.175741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 607/1178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:11 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:12.193541 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:12.194230 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:12.200310 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:12.200757 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:12.201506 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:12.201939 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:12.328692 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:12.335953 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-0f71d01b-dd49-4f1d-86d6-8aa5532d9b43 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.147045 May 11 06:53:12.337068 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 572/1179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:12 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:13.353942 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:13.354702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:13.362244 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:13.362707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:13.363509 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:13.363953 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:13.498470 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:13.505828 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a2e2212f-9f55-4bbb-ba9d-f315eebaf752 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.156507 May 11 06:53:13.506394 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 608/1180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:13 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:14.522534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:14.523142 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:14.529573 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:14.530016 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:14.530771 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:14.531201 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:14.662028 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:14.669659 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-956326fc-b649-45c9-8af3-edd6581597df tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.150930 May 11 06:53:14.670223 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 573/1181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:14 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:15.686488 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:15.687034 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:15.693408 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:15.693862 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:15.694651 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:15.695117 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:15.820121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:15.828277 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ccd896ec-3607-4469-b868-47b8977e254d tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.145466 May 11 06:53:15.828844 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 609/1182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:15 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:16.845591 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:16.846165 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:16.852835 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:16.853283 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:16.854038 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:16.854469 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:16.982662 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:16.989860 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-02a40a38-fa0b-4744-9162-c71773b1d149 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.148198 May 11 06:53:16.990409 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 574/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:16 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:18.006707 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:18.007346 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:18.013646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:18.014089 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:18.014840 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:18.015284 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:18.140763 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:18.148033 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-58b0dce3-a74c-41dc-b2c4-385baa7cd08c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.145183 May 11 06:53:18.149100 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 610/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:18 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:19.165567 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:19.166178 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:19.172785 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:19.173233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:19.173997 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:19.174432 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:19.308542 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:19.317868 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-a2b61cb5-8e15-4587-8fdf-2e5042aeece4 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.156159 May 11 06:53:19.318447 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 575/1185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:19 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:20.334909 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:20.335544 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:20.342449 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:20.342902 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:20.343702 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:20.344141 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:20.473067 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:20.481116 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d61f8078-ac19-44f0-b190-49a46a705858 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.149964 May 11 06:53:20.482069 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 611/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:20 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:20.961019 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [req-4f5226f1-8385-44d9-92ab-d5aa293be849 req-bee34df8-572e-4c8b-992d-9529645ce336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f55e67e-91fb-44d2-b518-109bd956ad67", "name": "network-vif-plugged", "status": "completed", "tag": "99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf"}]} {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:53:20.970560 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-4f5226f1-8385-44d9-92ab-d5aa293be849 req-bee34df8-572e-4c8b-992d-9529645ce336 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:20.971086 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [req-4f5226f1-8385-44d9-92ab-d5aa293be849 req-bee34df8-572e-4c8b-992d-9529645ce336 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:20.983331 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.compute.server_external_events [req-4f5226f1-8385-44d9-92ab-d5aa293be849 req-bee34df8-572e-4c8b-992d-9529645ce336 service nova] Creating event network-vif-plugged:99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf for instance 6f55e67e-91fb-44d2-b518-109bd956ad67 on hv-cinder-80475 May 11 06:53:20.988513 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [req-4f5226f1-8385-44d9-92ab-d5aa293be849 req-bee34df8-572e-4c8b-992d-9529645ce336 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031211 May 11 06:53:20.989340 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 576/1187] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:53:21.499456 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:21.500008 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:21.506232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:21.506672 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:21.507472 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:21.507883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:21.633898 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:21.641123 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e580e3f7-b004-48cd-a682-c00cadcf3720 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.145741 May 11 06:53:21.641689 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 612/1188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:21 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:22.658344 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:22.659057 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:22.666367 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:22.666814 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:22.667613 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:22.668049 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:22.809279 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:22.816534 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-2949d98b-fdbd-4d9b-b05b-eb9be1dd3257 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1267 microversion: 2.1 time: 0.162390 May 11 06:53:22.817104 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 577/1189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:22 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:23.833801 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:23.834354 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:23.840673 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:23.841121 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:23.841883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:23.842317 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:23.967863 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:23.975114 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-443f59d3-2e94-478b-a770-3672c485aa6b tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1454 microversion: 2.1 time: 0.145298 May 11 06:53:23.975718 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 613/1190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:23 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:23.991481 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:53:23.992095 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:53:23.999052 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:23.999527 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:24.000292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:24.000730 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:24.130586 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:53:24.137913 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-6e536482-6292-484f-a530-2a3d16146014 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1454 microversion: 2.1 time: 0.150304 May 11 06:53:24.138478 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 578/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:53:23 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:53:26.025391 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-38ac8d97-ada0-44ec-9185-b0a69673fc97 req-3a485249-ffd7-4602-8fb8-a685d9cb0ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f55e67e-91fb-44d2-b518-109bd956ad67", "tag": "99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:53:26.033294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-38ac8d97-ada0-44ec-9185-b0a69673fc97 req-3a485249-ffd7-4602-8fb8-a685d9cb0ad0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:53:26.033741 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-38ac8d97-ada0-44ec-9185-b0a69673fc97 req-3a485249-ffd7-4602-8fb8-a685d9cb0ad0 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:53:26.045120 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-38ac8d97-ada0-44ec-9185-b0a69673fc97 req-3a485249-ffd7-4602-8fb8-a685d9cb0ad0 service nova] Creating event network-changed:99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf for instance 6f55e67e-91fb-44d2-b518-109bd956ad67 on hv-cinder-80475 May 11 06:53:26.050371 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-38ac8d97-ada0-44ec-9185-b0a69673fc97 req-3a485249-ffd7-4602-8fb8-a685d9cb0ad0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029142 May 11 06:53:26.051097 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 614/1192] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:54:10.043854 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:54:10.044596 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:54:16.270638 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:54:16.271231 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:54:54.558035 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-c0c94bf7-5397-43e9-9486-d440e09c4194 req-972d57a3-a478-4253-8077-7fa199a4d767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f55e67e-91fb-44d2-b518-109bd956ad67", "tag": "99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:54:54.564847 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:54:54.565333 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:54:54.566858 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c0c94bf7-5397-43e9-9486-d440e09c4194 req-972d57a3-a478-4253-8077-7fa199a4d767 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:54.567320 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c0c94bf7-5397-43e9-9486-d440e09c4194 req-972d57a3-a478-4253-8077-7fa199a4d767 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:54.571172 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:54.571669 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:54.572583 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:54.573511 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:54.579883 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-c0c94bf7-5397-43e9-9486-d440e09c4194 req-972d57a3-a478-4253-8077-7fa199a4d767 service nova] Creating event network-changed:99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf for instance 6f55e67e-91fb-44d2-b518-109bd956ad67 on hv-cinder-80475 May 11 06:54:54.584922 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-c0c94bf7-5397-43e9-9486-d440e09c4194 req-972d57a3-a478-4253-8077-7fa199a4d767 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032111 May 11 06:54:54.585862 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 615/1193] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:54:54.600410 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:54:54.684632 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-1dbc2021-9a2e-4244-b88b-9c2a7b24145a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 204 len: 0 microversion: 2.1 time: 0.133949 May 11 06:54:54.688602 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 579/1194] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:54:54 2022] DELETE /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:54:54.694018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:54:54.694766 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:54:54.701732 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:54.702220 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:54.702986 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:54.703545 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:55.018324 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:54:55.027484 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4b2a6b56-244a-4821-aa5a-d3cd56ee01d0 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1579 microversion: 2.1 time: 0.337626 May 11 06:54:55.028057 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 616/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:54:54 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1579 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:54:56.045645 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:54:56.046354 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:54:56.052895 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:56.053353 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:56.054130 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:56.054569 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:56.236191 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:54:56.243485 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-32ba190f-5b20-43dc-b966-43c552cf6700 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1579 microversion: 2.1 time: 0.202100 May 11 06:54:56.244045 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 580/1196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:54:56 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1579 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:54:56.898726 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-598cf44c-e390-4840-9eb2-6ecb16b9315c req-64efa266-e7ae-4773-ade4-ebb6871a6e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f55e67e-91fb-44d2-b518-109bd956ad67", "name": "network-vif-deleted", "tag": "99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:54:56.907137 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-598cf44c-e390-4840-9eb2-6ecb16b9315c req-64efa266-e7ae-4773-ade4-ebb6871a6e59 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:56.907613 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-598cf44c-e390-4840-9eb2-6ecb16b9315c req-64efa266-e7ae-4773-ade4-ebb6871a6e59 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:56.918804 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-598cf44c-e390-4840-9eb2-6ecb16b9315c req-64efa266-e7ae-4773-ade4-ebb6871a6e59 service nova] Creating event network-vif-deleted:99d6cba5-ce69-48e1-b1b3-d5b4de0acdaf for instance 6f55e67e-91fb-44d2-b518-109bd956ad67 on hv-cinder-80475 May 11 06:54:56.923646 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-598cf44c-e390-4840-9eb2-6ecb16b9315c req-64efa266-e7ae-4773-ade4-ebb6871a6e59 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028515 May 11 06:54:56.924268 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 617/1197] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:54:57.260696 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:54:57.261305 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:54:57.267768 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:57.268498 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:57.269269 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:57.269707 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:57.339150 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:54:57.346570 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4da4b9ee-ad13-47ff-aeda-98443f365bb7 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 200 len: 1226 microversion: 2.1 time: 0.089808 May 11 06:54:57.347131 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 581/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:54:57 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:54:58.364865 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:54:58.365561 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 6f55e67e-91fb-44d2-b518-109bd956ad67] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:54:58.372380 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:58.372839 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:58.373597 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:54:58.374030 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:54:58.387140 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] HTTP exception thrown: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Request method failure captured: May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 HTTP/1.1 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1wXr_jG5rknZEWbqFIDIIQvAEdSPcBNjdoHv804Uo_FjLMBe1LHz9N9lahl2X2CXokr1laNO93ZS-SYllBfGR5XSJxtCocUOYzc6bBNQBWOev-cIQGLsLkr4l-6GtXA5qBctC5Tr6eIaG-ImXXbA6cvo5aZTAbSPhnND936vuKr9SI May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:54:58.388771 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-TestVolumeBootPattern-1695130078 May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-TestVolumeBootPattern-1695130078-project May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 94cdac893464447ea8753d29ac7c629b May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-TestVolumeBootPattern-1695130078-project May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. May 11 06:54:58.390462 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '6f55e67e-91fb-44d2-b518-109bd956ad67'} May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:54:58.391473 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. May 11 06:54:58.393201 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:54:58.394647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Returning 404 to user: Instance 6f55e67e-91fb-44d2-b518-109bd956ad67 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:54:58.394647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e828206c-2f8c-4fe4-89b9-0760c40d4a8c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67" status: 404 len: 111 microversion: 2.1 time: 0.029949 May 11 06:54:58.394647 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 618/1199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:54:58 2022] GET /compute/v2.1/servers/6f55e67e-91fb-44d2-b518-109bd956ad67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:55:01.445900 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:01.446404 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:01.448615 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-9e990a9f-444a-4cc0-8329-db3f54000a18 req-cdc99cd3-f32e-4872-9df3-5309af362996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099e2318-b1a5-41e1-b650-788036a4e19a", "tag": "63deefb4-c65e-4800-9773-117330932a29"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:55:01.453246 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:01.453927 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:01.454957 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:01.455596 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:01.458486 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9e990a9f-444a-4cc0-8329-db3f54000a18 req-cdc99cd3-f32e-4872-9df3-5309af362996 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:01.459173 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9e990a9f-444a-4cc0-8329-db3f54000a18 req-cdc99cd3-f32e-4872-9df3-5309af362996 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:01.470392 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-9e990a9f-444a-4cc0-8329-db3f54000a18 req-cdc99cd3-f32e-4872-9df3-5309af362996 service nova] Creating event network-changed:63deefb4-c65e-4800-9773-117330932a29 for instance 099e2318-b1a5-41e1-b650-788036a4e19a on hv-cinder-80475 May 11 06:55:01.475970 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-9e990a9f-444a-4cc0-8329-db3f54000a18 req-cdc99cd3-f32e-4872-9df3-5309af362996 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031157 May 11 06:55:01.477295 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 619/1200] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:55:01.481470 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Going to try to terminate instance {{(pid=128923) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:55:01.565032 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-bf088317-0b3e-4138-a510-5ae7277e85aa tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 204 len: 0 microversion: 2.1 time: 0.122518 May 11 06:55:01.566937 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 582/1201] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:55:01 2022] DELETE /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:55:01.574999 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:01.575745 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:01.582778 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:01.583230 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:01.584199 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:01.584611 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:01.717303 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:55:01.724882 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-47e60d73-ba50-464f-b9e5-ea989e04d466 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1579 microversion: 2.1 time: 0.154121 May 11 06:55:01.725458 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 620/1202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:55:01 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:55:02.742548 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:02.743259 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:02.750347 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:02.750687 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:02.751503 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:02.751942 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:02.882741 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:55:02.890262 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-fb8654df-3167-44e0-8788-5d9f843802c5 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1579 microversion: 2.1 time: 0.151957 May 11 06:55:02.890825 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 583/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:55:02 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:55:03.692842 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-7ddbc1c2-e545-4dff-b8d7-b9d3f398bcfe req-dc3a5488-0094-4012-8ae8-173155943161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099e2318-b1a5-41e1-b650-788036a4e19a", "name": "network-vif-deleted", "tag": "63deefb4-c65e-4800-9773-117330932a29"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:55:03.703570 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7ddbc1c2-e545-4dff-b8d7-b9d3f398bcfe req-dc3a5488-0094-4012-8ae8-173155943161 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:03.704011 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7ddbc1c2-e545-4dff-b8d7-b9d3f398bcfe req-dc3a5488-0094-4012-8ae8-173155943161 service nova] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:03.717789 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-7ddbc1c2-e545-4dff-b8d7-b9d3f398bcfe req-dc3a5488-0094-4012-8ae8-173155943161 service nova] Creating event network-vif-deleted:63deefb4-c65e-4800-9773-117330932a29 for instance 099e2318-b1a5-41e1-b650-788036a4e19a on hv-cinder-80475 May 11 06:55:03.724465 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-7ddbc1c2-e545-4dff-b8d7-b9d3f398bcfe req-dc3a5488-0094-4012-8ae8-173155943161 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 May 11 06:55:03.725066 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 621/1204] 10.222.0.64 () {64 vars in 1317 bytes} [Wed May 11 06:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:55:03.907482 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:03.908010 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:03.914294 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:03.914739 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:03.915518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:03.915950 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:03.984517 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.policy [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94cdac893464447ea8753d29ac7c629b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549cd5f2cff143c69dd1e4568d7bd3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128923) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:55:03.994183 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-b54e2a7e-bf0a-4590-83fc-388ea614e7f2 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 200 len: 1225 microversion: 2.1 time: 0.090609 May 11 06:55:03.995839 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 584/1205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:55:03 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:55:05.013539 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:05.014163 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 099e2318-b1a5-41e1-b650-788036a4e19a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:05.020777 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.021232 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.022005 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.022438 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.035988 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] HTTP exception thrown: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Request method failure captured: May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a HTTP/1.1 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1wXr_jG5rknZEWbqFIDIIQvAEdSPcBNjdoHv804Uo_FjLMBe1LHz9N9lahl2X2CXokr1laNO93ZS-SYllBfGR5XSJxtCocUOYzc6bBNQBWOev-cIQGLsLkr4l-6GtXA5qBctC5Tr6eIaG-ImXXbA6cvo5aZTAbSPhnND936vuKr9SI May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:55:05.037574 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 94cdac893464447ea8753d29ac7c629b May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. May 11 06:55:05.039200 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '099e2318-b1a5-41e1-b650-788036a4e19a'} May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:55:05.040154 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. May 11 06:55:05.041642 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.043018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Returning 404 to user: Instance 099e2318-b1a5-41e1-b650-788036a4e19a could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:55:05.043018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9d908ada-aecd-4416-968d-40ae3a09dc76 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a" status: 404 len: 111 microversion: 2.1 time: 0.030242 May 11 06:55:05.043018 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 622/1206] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:55:05 2022] GET /compute/v2.1/servers/099e2318-b1a5-41e1-b650-788036a4e19a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:55:05.482518 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:05.483039 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.compute.api [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128923) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:05.489292 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.489740 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.490492 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.490921 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG oslo_concurrency.lockutils [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.504703 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.wsgi [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] HTTP exception thrown: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Request method failure captured: May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: request: DELETE /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 HTTP/1.1 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept: application/json May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Accept-Encoding: identity May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Connection: close May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Length: 0 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Content-Type: application/json May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Host: 10.222.0.64 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Openstack-System-Scope: None May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: User-Agent: python-urllib3/1.26.9 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Auth-Token: gAAAAABie1wXr_jG5rknZEWbqFIDIIQvAEdSPcBNjdoHv804Uo_FjLMBe1LHz9N9lahl2X2CXokr1laNO93ZS-SYllBfGR5XSJxtCocUOYzc6bBNQBWOev-cIQGLsLkr4l-6GtXA5qBctC5Tr6eIaG-ImXXbA6cvo5aZTAbSPhnND936vuKr9SI May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Id: None May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Domain-Name: None May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Identity-Status: Confirmed May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Is-Admin-Project: True May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Id: default May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Domain-Name: Default May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Project-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Role: reader,member May 11 06:55:05.506328 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Roles: reader,member May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Id: default May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Domain-Name: Default May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Id: 94cdac893464447ea8753d29ac7c629b May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: X-User-Name: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: method: > May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: exception: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.507968 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: action_args: {'id': '2605ddbc-2797-403c-937d-fa10bb1df1b8'} May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:55:05.508918 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.510171 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: ERROR nova.api.openstack.wsgi May 11 06:55:05.512996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Returning 404 to user: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. {{(pid=128923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:55:05.512996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-5d01f9a8-c57f-48db-9912-7a61becbd915 tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 404 len: 111 microversion: 2.1 time: 0.029016 May 11 06:55:05.512996 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 585/1207] 10.222.0.64 () {58 vars in 1238 bytes} [Wed May 11 06:55:05 2022] DELETE /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:55:05.516933 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:05.517552 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] [instance: 2605ddbc-2797-403c-937d-fa10bb1df1b8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:55:05.523469 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.523918 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.524676 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:55:05.525142 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Lock "b5f3ff89-f423-4501-b582-30555b4750ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:55:05.538053 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] HTTP exception thrown: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Request method failure captured: May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 HTTP/1.1 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept: application/json May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Connection: close May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Host: 10.222.0.64 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABie1wXr_jG5rknZEWbqFIDIIQvAEdSPcBNjdoHv804Uo_FjLMBe1LHz9N9lahl2X2CXokr1laNO93ZS-SYllBfGR5XSJxtCocUOYzc6bBNQBWOev-cIQGLsLkr4l-6GtXA5qBctC5Tr6eIaG-ImXXbA6cvo5aZTAbSPhnND936vuKr9SI May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 11 06:55:05.539579 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/549cd5f2cff143c69dd1e4568d7bd3e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 549cd5f2cff143c69dd1e4568d7bd3e6 May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695130078 May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Id: 94cdac893464447ea8753d29ac7c629b May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-TestVolumeBootPattern-1695130078-project May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: method: > May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: exception: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.541166 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: action_args: {'id': '2605ddbc-2797-403c-937d-fa10bb1df1b8'} May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:55:05.542096 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. May 11 06:55:05.543616 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 11 06:55:05.545294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Returning 404 to user: Instance 2605ddbc-2797-403c-937d-fa10bb1df1b8 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:55:05.545294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-68027362-6cac-42db-890b-112220afbd9a tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8" status: 404 len: 111 microversion: 2.1 time: 0.027793 May 11 06:55:05.545294 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 623/1208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed May 11 06:55:05 2022] GET /compute/v2.1/servers/2605ddbc-2797-403c-937d-fa10bb1df1b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:55:06.828355 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: DEBUG nova.api.openstack.wsgi [None req-4ca17d8f-c762-4928-b854-9a3b08562c3c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] Calling method '.version_select at 0x7fc5c83471f0>' {{(pid=128923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:55:06.853811 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO nova.api.openstack.requestlog [None req-4ca17d8f-c762-4928-b854-9a3b08562c3c tempest-TestVolumeBootPattern-1695130078 tempest-TestVolumeBootPattern-1695130078-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340440310" status: 202 len: 0 microversion: 2.1 time: 0.029174 May 11 06:55:06.855170 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: [pid: 128923|app: 0|req: 586/1209] 10.222.0.64 () {58 vars in 1262 bytes} [Wed May 11 06:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340440310 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:56:02.560276 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:56:02.560906 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:57:30.066322 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:57:30.066951 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:57:36.279592 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:57:36.280233 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:57:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:57:37.114537 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:57:37.115072 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:57:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:57:50.179029 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:57:50.179646 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:57:56.311755 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:57:56.312299 dv-cinder-804757-27-iscsi devstack@n-api.service[128924]: Wed May 11 06:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:59:22.568217 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:59:22.568689 dv-cinder-804757-27-iscsi devstack@n-api.service[128923]: Wed May 11 06:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!